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\ METHOD FOR QUANTIFYING THE EXTENT OF 
PUPILS’ LEARNING EXPERIENCES 


WILLIAM A. BROWNELL 
Duke University 


Editor's note: Educational workers are always in need of better data 
gathering devices. The author presents data relative to certain means em- 
loyed in quantifying the varying amounts of experience of third grade 


pupils in phonetic analysis. 
IN CONNECTION with a study the results of which were published 
me months ago! it was necessary to ascertain the varying extents to which 
hird-grade pupils had been given training in phonetic analysis in primary 
eading. No means was at hand for securing the needed information. Tests 
could yield no relevant data; the pupils could not furnish the required facts; 
ind the teachers were practically as helpless. There is no known way of 
nterpreting precisely such teacher statements as ‘‘not much phonetic train- 
‘or “a good deal of practice in phonetic analysis; and errors of inter- 
pretation would only have been multiplied by combining for any pupil the 
series of such statements from the different teachers he had had in the 


hree years of his school life. 

This article describes the method which was finally evolved to quantify 
the varying amounts of experience the experimental subjects had had in 
phonetic analysis. The purpose of the description and of the article, how- 
ver, transcends the particular problem originally under study. That is to 
ay, the center of interest here is only incidentally related to the fact that 
me phase of reading instruction was being investigated. Rather, it is felt 


‘Donald G. Agnew, The Effect of Varied Amounts of Phonetic Training on 
Primary Reading. Duke University Research Studies in Education, No. 3 (Durham, 
C.: Duke University Press, 1938), p. 86. Most of the data concerning this study 
which are reproduced in the following pages were taken from this monograph; the 
rest were taken from Dr. Agnew's more complete thesis report, on file in the Duke 


University Library. 
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that the research technique employed is of general usefulness, particularly 
in educational areas which, like that of instruction in phonics, are high\y 
controversial. 


THE METHOD USED 


ale 


The first step in the procedure was to have each third-grade pupil lis 
the names of the teachers he had had during the five preceding terms or 
semesters. (The term was selected as the unit for quantifying experienc 
largely because of the possibility of changes in teachers within grades, a; 
through mid-year promotion.) Since the schools used in this study, namely 
the schools of Raleigh and of Durham, North Carolina, are unusually 
both in their pupil and in their teacher personnel, practically all of the 
dren were able to supply their teachers’ names. In the few cases where thi 
could not be done, the school records were consulted. 


The second step was to have all of the teachers whose names appeared 
on the pupils’ lists fill out blanks, described below, which revealed the 
amounts of attention they had given to phonetic analysis during the five 
preceding semesters. Teachers who had changed grades during this time or 
had in a material way changed their emphasis on phonetic analysis were 
asked to fill out separately a blank for each such change. A few teachers had 
left the systems prior to the time of the study. Several of these were reached 
by mail. When it was impossible to locate teachers who had moved or t 
secure blanks from teachers who could be located, the pupils affected wer 
eliminated from the study. Only pupils could be used for whom Manks 
were available from all the teachers they had had during the preceding 
five terms. 

The third step was to score teachers’ blanks so as to obtain quantitati 
indices to correspond with their relative emphasis on phonetic analysis. This 
need had of course been foreseen when the blanks were prepared. To this 
end the blanks listed twenty-five activities or practices relating to phonet! 
analysis which teachers may or may not engage in. For example, one practi 
is to teach the consonant blends, such as tr- and bl-. At the one extreme 
(usually designated on the blank with the letter 2) is the possibility of teach- 
ing all such blends. At the opposite extreme (usually designated @) is t 
possibility of teaching none of the consonant blends as such. Between the 
two extremes are the possibilities of teaching, say, all of the common blends 
(6) and of teaching only a few of the commonest (c). 
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f the other twenty-four activities included on the teachers’ blanks 

eptible in the same way to varying degrees of emphasis, from very 

(2) to none at all (d), and teachers in responding to the blank merely 

the letter which best identified their own practice with respect to 

For the purposes of the original study each activity was described 

degrees of emphasis, and score values of 4, 3, 2, and 1 were ar- 

assigned the letters which corresponded to the degrees of emphasis, 

» assigned to the greatest emphasis and 1, to the least. Obviously, 

a given teacher's score could lie anywhere between 25 (the least 

ittention to each of the twenty-five practices) and 100 (the largest 
amount of emphasis), with a potential range of 75 points. 

fourth step was to derive for each third-grade pupil a total score 

for his experience in phonetic analysis for his whole school life 

This was easily done by transcribing the score of each teacher on 

nk and then by adding the Separate scores to get his total experience 

[here being five teacher-scores for each pupil (teachers who had a 

1r both terms of a school year contributed two scores to his total), 

sible low phonetic experience score was 125 (5 x 25), and the pos- 

igh score was 500 (5 x 100), and the potential range was 375 points. 

[he four steps just outlined relate to the original study and yielded, as 

ned, a twenty-five item check list. Later this blank was revised and 

ened by the addition of five new items. So changed, the blank was 

tted to several hundred primary teachers scattered throughout thir- 

in order to determine (1) what actually are current classroom 

es with respect to training in phonetic analysis and (2) what influ- 

ertain factors (length of service, educational philosophy, etc.) have 

) these practices.? In order to differentiate between the two studies, the 

new investigation will be designated as the “first” or the “original” 

and the more recent investigation as the “‘second’’ study. Likewise, 

henever it is important to discriminate between the two check lists the 


rms “original” or “twenty-five item” will identify the first blank. 


There is no point in reproducing the entire blank in this place, since, 
has already been explained, the purpose of this article is to exemplify a 


* The results of the second study have been recently published. See: William A. 
wnell, “Current Practices with Respect to Phonetic Analysis in the Primary Grades.” 
nentary School Journal, XLII (November, 1921), 195-206. 
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method and to show its uses. Instead, therefore, it will suffice to select , 
sample of six items which were common to both teachers’ blanks: 


1. With respect to phonetic training, I 
fa) follow a standard system or manual; 
(b) use a complete system of my own; 
(c) follow rather well defined practices which however can 
hardly be called a system; 
(d) make no attempt to follow any system, my own or any 
other. 


4. I give instruction in phonetic analysis 
(a) to the class as a whole; 
(b) to groups or sections of the class which seem to need 
such instruction ; 
(c) individually, as needed; 
(d) not at all. 


------ 7. One form of “ear training” consists in having some child make 
the separate sounds of a word and then in having some other 
child pronounce the whole word. I do this 
(a) regularly; 

(b) frequently ; 
(c) occasionally; 
(d) never, or practically never. 


11. With respect to suffixes (-ed. -tion, etc.), I teach 
(a) all of them possible; 
(b) a large number; 
(c) just a few of the commonest; 
(d) none at all as such. 


------16. I give practice in sounding nonsense syllables and words 
phonetically 
(a) regularly and frequently; 
(b) rather frequently ; 
(c) occasionally; 
(d) never, or practically never. 


------19. I require the sounding of the individual letters or combinations 
in new words encountered in reading 
(a) regularly before the word is pronounced for the first 
time ; 
(b) regularly after the word has been pronouriced as a whole 
(c) for all new words, but only as needed; 
(d) not at all. 
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G24 


essential features of the teacher's blank and of the procedure of 


rT} 
ine 


: h it is a part are these: (1) a single quantitative measure of pupil ex- 


nce is obtained; (2) this pupil measure is gotten indirectly, from 
rs’ statements with regard to their actual classroom activities; (3) in 
process of self-analysis teachers deal with specific concrete practices, and 
vith such vague generalities as “phonetics” and “phonetic training;” 
(4) the final quantification is unobstrusive; it does not impress teach- 
s the primary purpose of their analyses of their teaching practices. On 
other hand, there are certain limitations and assumptions which must 
yenized. These will be discussed in the last section of this paper. 


EVIDENCE WITH REGARD TO VALIDITY AND RELIABILITY 


n this method of quantifying pupil experience the crucial element (in 
n to the assumptions just mentioned) is the teacher's blank. On this 
t this section of the report is devoted to a discussion of the validity 

| the reliability of the blank as it was used. The next section treats of 

alues of the blank and of the teachers’ scores thereon for the purposes 
which the blank was devised,—and, by implication, the values of 


lar blanks constructed to study similar problems in other instructional 


i 


dity of the Blank 
The best source of evidence for the validity of the blank is to be had 
m an examination of its contents, only a few sample items of which 
wever have been given in this report. There is reason to believe that all 
e items, both the twenty-five in the first blank and the five new items 
1 in the revision, represent genuine phonetic activities in which teach 
nay or may not have their pupils engage. The original items were ob- 
ned (1) from an examination of texts on the teaching of reading, of 
ichers’ manuals which accompany series of readers, and of periodical 
iterature on phonetic analysis, as well as (2) from the experience and 
bservations of the writer and of his colleague, Dr. John W. Carr, who is a 
specialist in reading. These twenty-five items were (3) later scrutinized 
ind approved with minor modifications by Dr. James W. Evans, Director 
Research in the St. Joe, Mo., public schools, by Dr. L. S. Tireman, of 
the University of New Mexico, a specialist in reading, and by their gradu- 
ite students enrolled in the Duke University Summer Session of 1939. At 
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this time too the five mew items were added. (4) Moreover, both blank 
had the benefit of criticism from classroom teachers whose responses w 
not however tabulated with those of experimental teachers. 

Likewise, the four alternatives for each activity (the alternati 
shown in the sample items above, revealed the frequency and reg 
with which the activities were provided) ,—these alternatives were as 
genuine as were the basic activities. Convincing evidence on this po 
found in the fact that every one of the one hundred alternatives i 
original blank and every one of the 120 in the second or later form of 
blank was checked by at least several teachers in each of Grades I, II 
ll. That is to say, some teachers in each grade-group identified as 


practices every degree of regularity and frequency described in the 


< 


There are several evidences that the blank is reliable. (1) The s 
on the original blanks for the odd-numbered items were correlated wit! 
scores on the even-numbered items (split-halves method). The result 
reliability coefficient, for 60 teachers of Grades I, II, and III combined 
pearman—Brown formula. (2) 
same procedure was applied in the case of the revised thirty-item 


96, when stepped up according to the S 
PI 5 


Here two different representative samples of one hundred teachers each 
vided the scores. The reliability coefficients were .921 and .925. (Thi 
new items were not all homogeneous with the original twenty-five it« 
hence, the later reliability coefhicients, though based upon longer “te 
were somewhat lower.) (3) The probable error of a score on the thi 


= 


item blank (565 cases) was found to be 3.1 points, a relatively small fig 
in view of the possible range of 90 points, from 30 to 120 
(4) One hundred ten teachers in a large system agreed to check 
blank twice. The second checking was done some months after the fi 
and the teachers were without records of their earlier responses. The pa 
of scores for ninety-eight teachers whose two blanks were complete w 
7 t 


then correlated. The coefficient was .774,. which does not seem to be ve 


high as compared with those reported above in (1) and (2). An infor 
and unexpected note, attached by a teacher to her second blank, probal 
explains the lowness of the last coefficient. This teacher reported that, f 


lowing the first administration of the check list, her principal changed tl 


school’s policy with regard to phonetic analysis, asking the primary teache i 
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blank sore emphasis to this phase of reading than had theretofore been 

- : Without exception the scores made by the teachers of this school 

second checking were materially higher than on their first blanks. 

mnsequent harmful effect on the reliability coefhcient. It is not im- 
that something similar happened in other schools to raise or to 
second scores as compared with the first. 


C 


\n item-by-item analysis was made of the alternatives checked by all 
y-eight teachers on the first and second blanks. The form used for 
. is illustrated for the first five items: 
nge (if any) on the Second Form 


i 





m a to | From b to From c to From d to 
a3 b c d a »b c d a »b ¢c d 
(same | same) (same) 

1 3 2 4 7 1 3 50 1 2 
as ': @& 4 | 2 11 85 2 2 4 4 
6 7 42 2 im 1 2 1 1 

9 4 7 24 3 | 2 2 1 1 1 

l 4 15 5 ze 6 30 : 

' 








figures above are read: Of the 23 teachers who selected alterna- 

n the first blank 19 held to the same alternative on the second blank, 
ed to alternative 6, and 3 shifted to alternative c; of the 13 who 
1 alternative & on the first blank, 4 held to the same alternative on 
econd, 2 shifted to a, 7 shifted to c, etc. These statements refer of 
rse to the responses to item 1; the responses to the other items are read 
ilar fashion. This form of tabulation permits a study of the amount 
ange, and of the precise nature of the change, from blank to blank. 


Teachers who checked the same alternative for a given item on both 

nks gave evidence of having responded reliably the first time. A total of 
a-alternatives were selected for the thirty items on the first checking, 
i35 of these (68.9 per cent) were checked the same way the second 
[he corresponding per cents for the other alternatives were: 66.9 
b-alternatives (875 b-alternatives selected the first time), 66.3 for c- 
lternatives (952 on the first blank), and 58.2 for d-alternatives (483 on 
: first blank). It is therefore safe to say that about 66 per cent of the 
ms were checked alike on the two blanks, and that to this extent the two 
heckings were exactly consistent. Another 28.2 per cent items were marked 





—— 


ee 
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differently the second time to the extent of one degree. Thus, 138 of the 
original 630 a-alternatives (2.9 per cent) were changed to 6 on the second 
blank; 128 of the 875 d-checks (15.7 per cent) were changed to 4; 136 of 


checks (19.7 per cent) were changed to 6, and 94 (9.9 per cent) to d; and 


the 6-checks (15.7 per cent) were changed to ¢; 188 of the original 952 
§ & 


140 of the original d-checks (28.9 per cent) were changed to ¢. A similar 
form of calculation showed that slightly more than 5 per cent of the tw 
checkings differed by two degrees (a to c, b, to d, ¢ to a, and d to b) ; the 
numbers involved in these comparisons were obviously small, ranging fron 
5 to 44. A negligible per cent of the items were checked differently by 


1 
; 
il 


ree degrees. 

hese figures serve to take some of the edge off the comparatively low 
reliability coefficient of .774 mentioned above, for they show that the teach 
ers, far f-om checking erratically, responded with a high degree of con 
istency. The amount of this consistency is said to be “high” because of 
the many factors which could have entered during the lapse of severa 
months, to lead to quite different practices with regard to phonetic 


instruction. 


Validity of Re spons 

The blank might be valid according to the bases described above, a 
it might be as reliable as the evidence cited seems to indicate, and still there 
would remain the question, What reason is there to believe that teachers 
checked the blanks honestly? What is the evidence that differences in scores 


| 


or example, reflected actual differences in classroom practices with regat 


; 


to instruction in phonics? Several types of evidence can be adduced, some ol 
them admittedly anecdotal in character, but the last one objective and 
perhaps more convincing on that account. 

(1) In both studies in which the blank was used an attempt was ma 
remove any cause for less-than-frank answers by stressing the nature 
he problem. (a) In the first study the purpose of the investigation, to 
determine the effects upon reading ability of varying amounts of experience 
n phonetic analysis, appealed to the teachers and, it is believed, led then 


because of ‘‘vested interests’ in the problem to give honest answers. (b) In 


he second investigation also the nature of the problem, namely, to dete 
y 


mine current practices with regard to phonetic analysis, was stressed in 


way which emphasized its character as a survey; it was possible to show 
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rs that their identity would be lost in the statistical treatment to estab- 
trends. (c) In both studies the teachers were assured that their blanks 
1 not be examined by their superiors, and in the second study teachers 
xcused from signing their names if they so wished. 
(2) The place of instruction in phonetic analysis was a live issue in 
irly large school system, well known to the writer. The scores from 
teachers there, obtained in the first study, yielded a bimodal distribution, 
ting the tendency of the teachers to take sides, and the two modes 
separated by 20 points. The amount of this difference is made more 
nificant when one realizes that the total range on scores was but 45 points, 
higher possible scores not being represented in the returns from this 
system. The two modes fell in the class intervals 60-64 (13 teachers) and 
i4 (19 teachers). In only one other class interval were there as many 
8 teachers. 
(3) One second-grade teacher had the reputation among her fellow 
hers of doing nothing about phonetic analysis; nevertheless, her blank 
iled a score slightly above average. The city supervisor, who by reason 
se and frequent contacts with all her teachers knew what went on in 
eir classrooms, confirmed the self-evaluation of the teacher in question, 
1 this without knowing anything about the occasion for consulting her 
ibout the answers on the teacher's blank. 
(4) Two schools in a system with which the writer is intimately ac- 
nted were known to emphasize phonetic training to an unusual extent 
110 third-grade pupils in these schools all had phonetic experience 
res in excess of 370 out of a possible 500 points, with the median at 376. 
se scores are to be contrasted with those obtained in the third grades of 
her system, also well known to the writer, in which comparatively little 
done with systematic training in phonetic analysis. None of the 230 
pils in this group had phonetic experience scores as high as 350, and their 
edian was 267 
(5) Reference has already been made (page 00 above) to the fact 
that, in the second study, the scores of certain teachers who checked the 
blank twice rose considerably the second time, after their principal had 
hanged his policy to give more attention than had previously been true, to 
phonetic analysis in reading. 
(6) In the second study a definite relationship was found between 


local supervisory policy on the one hand and teachers’ scores on the other 





a 
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hand. Data on this point were available from 503 teachers. The median 
score for teachers of Grades I, II, and III combined, in schools where ip 
struction in phonetic analysis was supposed to be “regular and systematic 
was 82; the median of teachers who operated under a policy of “regula: 
but not necessarily systematic’ instruction was 78; that of teachers whose 
supervisory policy was to make such instruction “purely incidental’ was 69 
All the differences are reliable. Furthermore, this trend was in | 
confirmed by the data for the separate grades, save that these differences 
were not all reliable because of the smailer numbers of cases. In Grade | 
the three medians which correspond to the three policies described 
vere 80, 73, and 59; in Grade II they were 78, 78, and 66; and in Grad 
III they were 84, 82, and 73. Teachers in schools where there was no know: 
policy with regard to phonetics tended to do very little with them, as might 
be expected, but the practice in this respect was much more vari 
(Q 10) than was the case in any of the three other policy-groups 
largest among the other Q’s was 8.0). The latter condition might also | 
been anticipated 

It may not be unwise to reiterate the purpose of thus reportin 
detail facts about the reliability and validity of a research instrument w! 
is not even reproduced in the article. The purpose is less to prove that 
particular device in question was valid and reliable than to show that 


research instruments can be devised in controversial areas of instruction 


further, to illustrate some of the tests of reliability and validity which 
be applied. If this purpose can be achieved, others may be encouraged 
undertake the study of problems which have not as yet been susceptible 


juarititative investigation because appropriate means have been lacking. 


USEFULNESS OF THE TEACHERS BLANK 


(1) The purpose of the first study was to ascertain the effect of vary 
ing amounts of phonetic training on certain reading abilities. The twenty 
five item teacher's blank was designed, as has been explained, primarily 
1 means of indexing the extent of experience third-grade pupils had ha 
in phonetic analysis. This was done indirectly by first determining t 
amount of emphasis teachers gave to phonetic analysis. The blank served it 
purpose admirably. It differentiated among amounts of teacher emphas 


I 
and so among amounts of pupil phonetic experience. The possible range : 
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rience was 375 points, from 125 (which, if it had been found, 
meant no experience at all) to 500 (which would have been the 
amount). The range found in one system, where the supervisory 
but mildly in favor of phonetic analysis, was from 160 to 348 
ils in the second term of Grade III). (a) The first comparison of 
bility involved those pupils who were at the extremes of the dis- 
86 pupils with phonetic experience scores above 290 and 89 pupils 
below 230. (b) Next, the effects of differing patterns of ex- 
s studied. The reading abilities of pupils who, for example, had 
phonetic training in Grade I, a moderate amount in Grade II, 
ittle in Grade III were compared with pupils who had had other 
ns of training. (c) Last of all, the teacher's blank made it pos- 
ocate 110 pupils in a second school system who had had very 
ounts of phonetic experience (the least amount was 353 points) 
ympare their reading abilities with those of the group mentioned 
) and (b). 
lifficult to see how the problem attacked in this study could have 
secuted other than through the use of the teacher's blank or a 
vice. Without this device the varying amounts of phonetic experi 
not have been determined. Likewise without some such device 
ts of varying amounts of instruction in other controversial areas 
susceptible to discovery. Just as the teacher's blank in this study 
the investigator to get at his problem, so similar instruments ought 
cther problems to research. 
(2) The thirty-item blank was used in the second study, first as a 
in order to survey common schoolroom practices with respect to 
training, and second as a means of examining the relationship be- 
amount of teacher emphasis on phonetic analysis on the one hand 
ther factors which might account for differences in emphasis. In neither 
was there any interest in the degree to which emphasis on phonetic 
lack thereof, affected reading as such. The factors which were 
ed in connection with the second problem named above were (a) 
(1, Il, or III), (b) place of teaching (city vs. rural schools), (c) edu- 
philosophy as expressed by the teachers themselves (“‘progressive,”’ 
of-the-road,” and “‘conservative”), (d) length of teaching experi- 


sawrVUieru 


(€) recency of course work in reading, as attested by the year of the 


Summer Session course taken in the field of reading, and (f) local 





— 
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supervisory policy (as requiring regular and systematic instruction, systematic 
instruction which need not be regular, purely incidental attention to phoneti 
analysis, and no known policy). 

This is not the place to report the results of the second study, any more 
than of the first study. Factors (a) to (f) are mentioned merely to 
rate the kinds of problems which are opened to quantitative study when one 
has a measure of amount of emphasis. And one can probably best sec 
the needed measures of amounts of emphasis by some such instrument 


the teacher's blank used in this study. 
LIMITATIONS AND ASSUMPTIONS 


There is no denying that the teacher's blank and the uses to wh 


was put are subject to certain limitations and that they involve assumpt 


which must be recognized. (1) The usual questions relating to the val 
and reliability of the blank itself have already been considered, as has 
(2) the question whether the responses made by the teachers accurat 
reflected their classroom practices. 

(3) The values (1 to 4) assigned the four alternatives for each 


were of course arbitrarily arrived at. The particular values for the alters 
tives for any item could be justified only by demonstrating that the varia 
practices represented by the alternatives differ from each other by the sa 


amount. It is impossible to demonstrate this equality of differences,—ind 
I J 


it is highly improbable that the differences are equal. On the other |! 
it to 


it is reasonable to suppose that the errors made in assigning values 
alternatives of one item might be compensated for, or balanced, by « 


teracting errors for the alternatives of others of the twenty-nine items. 7 


yuestion of values applies of course only to those aspects of the two stu 
i J I 


mentioned in which pupil-experience was to be quantified. It does not aj 
to that aspect of the second study in which an attempt was made to det 


line common practices with respect to instruction in phonetic analysis. | 


this case the critical issue is, not relative values of the alternatives, but rath 


the ability and intention of teachers to identify among the alternatives 


description of their classroom procedures with respect to each item 


activity 
(4) Another assumption made in obtaining teacher scores (and, | 
the first study, pupil-experience scores) is that the values of the thirty iter 


in be added to give a single measure of emphasis upon phonetic training 
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emiatic ‘ troublesome question here does not relate to the correctness of the 
honet es of the alternatives (errors at this point are assumed to cancel each 





s has just been explained) ; instead, it relates to the hypothesis that 
the thirty items should contribute equally to the total score,—that 
is just as important as are the others in indexing phonetic em- 


| One A cursory examination of the blank, were it available in this article, 


lead one to doubt the validity of this hypothesis, for some of the 

ties would on a priori grounds seem to be less vitally a part of phonetic 

s than are others; and other items would seem to overlap consid- 

thus perhaps giving extra weight to closely associated aspects of 

tion. About all one can do in connection with this assumption of the 

| weight of the thirty items is (a) to admit its existence, (b) to remind 

reader that the assumption is no more involved in the case of this blank 

s in the multitudinous instances of counting correct test items to 

rive at a score, and (c) to reiterate the fact that the measures obtained 

regularly treated for groups only, in which case the crudity of 
vidual measures loses some of its seriousness. 

(5) Another question, no more answerable than those already con- 

red, has to do with the functional relationships which exist between 

yn the teacher’s blank and instruction in reading as a whole. After 

no teacher scored the least possible nor the largest possible number of 

ts, and between these extremes, whatever the amount of phonetic em- 

isis which was quantified in the score, the phonetic activities were but 

of all the activities by means of which reading was taught. And the 

tionships which the phonetic activities bore in any instance to the other 

iding activities would have large bearing upon the significance of the 

er. Such variables, too, as time relationships between actual reading and 

phonetic analysis, the adjustments made for individual differences, and the 

i 


iad to be neglected in securing the single quantitative measure of 
nount of teacher emphasis and of pupil experience. Objections of this 
cind, valid when the purpose of a study is to determine what ought to be 
ione about phonetic analysis, are not so valid however when the purpose is, 
s here, in no way connected with optimum practices. In a word, this fifth 
mitation to the use of the teacher's blank (and to the use of other similar 
nstruments) is serious or not, depending upon the object or aim of the 


study in question. 
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CERTAIN CHARACTERISTIC DIFFERENCES BETWEEN 
EXCELLENT AND POOR ACHIEVERS IN 
TWO-FIGURE DIVISION* 


RoBERT H. KOENKER 
University of Minn ta 
Editor's note: There are many different approaches to the problem 


teaching and learning. The author applies with considerable success a « 


parative technique that doubtless deserves wider us« 


INTRODUCTION 

Ir 1s generally believed that excellent achievers differ from 
achievers in certain skills and abilities involved in two-figure division, | 
yet, no one has attempted by systematic study to discover the characte: 
if any, that distinguish these two kinds of achievers. If it can be shown t 
excellent achievers differ significantly from poor achievers in certain 
and abilities, the information will be of value in diagnosis. It will 
throw light on how to differentiate methods of instruction, practice 
terials, and courses of study in division according to the characterist 
the learner 

The purpose of this investigation was to discover if certain under! 
characteristics distinguish excellent achievers from poor achievers in div 


with two-figure divisors at the sixth grade level. 


PROCEDURE 

To select excellent and poor achievers a screening test in two-f 
division was constructed. This test contained at least three or more 
amples of each possible type of estimation, as well as a complete samp 
of zero types involved in both the quotient and dividend. The divi 
covered all decades and the second figures in them were well distrib 
between zero and nine. This screening test in two figure division is 
follows 

SCREENING TEST IN TWO-FIGURE DIVISION 


Part I—First Sitting (28 minutes) 


41/861 46/1948 17/578 29/1865 
37/3148 19/1659 68/6020 89/8184 
96/77568 23/16100 28/1136 52/11596 
75/7280 28/1879 37/30291 82/328168 


* Abstract of a doctor's dissertation written under the direction of Leo 
Brueckner, University of Minnesota 
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Part II—Second Sitting (28 minutes) 


34/408 44/2464 27/81162 75/72780 
38/30248 18/935 63/3180 19/1558 
29378 14/1372 29/1889 38/3022 
50/609 74/22289 55/3028 27/21462 

Ihe above screening test in two-figure division was then administered 


in the 6B classes in nine elementary schools of a large midwestern 
[hese nine schools were located in average residental areas, and the 
principals in these schools were rated in ability from average 
erior. In the nine schools two figure division was taught to completion 
end of the fifth grade. 
\fter administering the screening test in division; the Welch-Nayer 
for homogeneity of variability, and the analysis of variance test? for 
eneity of achievement were applied to the data to see if the nine 
ould be considered as of the same general pattern with respect to 
in two-figure division. These tests of homogeneity showed that the 
ls were homogeneous in two-figure division with respect to both vari- 
nd achievement. Therefore, it was permissible to group the nine 
as one distribution, for they could be considered as having come 
he same general population. 
In the 6B grades of the nine schools there was an enrollment of 283 
s. The upper one-third, the 94 best pupils were designated as excel- 
achievers, and the lower one-third, the 94 poorest pupils were desig- 
poor achievers. As several in each group transferred to other 
ools or were absent due to illness, final groups were limited, respectively, 
excellent and 90 poor achievers. There were excellent and poor 
uievers from all nine schools. The two-figure division screening test 
res of the 90 excellent achievers ranged from 22 to 32 with a mean of 
73, and the scores of the 90 poor achievers ranged from 0 to 10 with 


nean of 5.18. 


‘B. L. Welch, “Note on an Extension of the Li Test,” Statistical Research 

irs, I (June, 1936), 52-56 

P. P. N. Nayer, “An Investigation into the Applications of Neyman and Pear 
1's Ly Test, with Percentage Limits,” Statistical Research Memoirs, 1 (June, 1936), 


* George W. Snedecor, Statistical Methods. Ames, lowa: Collegiate Press, Inc., 
938. Pp. 179-181. 
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Additional statistical tests of homogeneity of variability and achieve 
ment showed that excellent achievers as a group and poor achievers as a 
group were of equal variability, but were heterogeneous or significantly dif 
ferent with respect to achievement in two-figure division. 

The 90 excellent achievers and the 90 poor achievers were then meas 
urd on the following factors or characteristics thought to be associated with 


ability in two-figure division. 
A. General Factors 
1. Mental age (California Test of Mental Maturity, Elementary 
Series, Grades 4—8)# 


2. General arithmetical background (Analytical Scales of Attainment 
in Arithmetic, Part IV, Fundamental Operations, Grades 5-6)* 
3. Reading (Gates Silent Reading Tests, Grades 3—8)* 


a. Type A, Reading to Appreciate General Significance 

b. Type C, Reading to Understand Precise Directions 

c. Type D, Reading to Note Details 
B. Spectfic Arithmetical Factors in Two-Figure Division 

Tests to measure the specific arithmetical factors in two-figure divisior 

were not available so they were constructed by the author with the aid of Dr 
Foster E. Grossnickle of New Jersey State Teachers College and Dr. Leo J 
Brueckner of the University of Minnesota. The tests and a sample row of 


examples from each test are as follows: 
1. Division with a one-figure divisor (25 examples—12 minutes) 
Divide 
2/68 5/767 4/800 6/5030 4/485 


2. Estimating the first quotient figure (24 examples—15 minutes) 
Write the first quotient figure in its proper place. Do not take time to finis 


the examples 


35/1326 28/2160 16/1347 21/806 
3. Placing the t quot figure (24 examples—214 minutes) 
In each exam} iraw a line through the figure above which you will place the 
st q it hg when livide 
18/5794 14/8826 14/1776 41/1848 


* Published by Southern California Book Depository, Ltd., 3636 Beverly Boule 


vard, Los Angeles, California 

*Published by Educational Test Bureau, Inc., Minneapolis, Minnesota. 

* Published by Bureau of Publications, Teachers College, Columbia University, 
New York City. 
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N 
ation as in division (24 examples—10 minutes) 
chieve ete the following examples by doing the multiplication and substraction. 
$5 as a tient figure is correct. 
ly dif 4 9 - 8 
19/182 74/531 39/319 
meas tion as in division (30 examples—6 minutes) 
1 Wit! 
364 507 834 136 80 
227 385 756 9S 57 
itary ng product and partial dividend (24 examples—5 minutes) 

{ark with a (c) the examples below in which the first quotient figure is cor- 
iment Mark with an (x) the examples in which the first quotient figure is not 
56) 4 t. All multiplications are correct 

9() _6() met ae 
1648 40/2158 46/3798 93/2673 
153 240 22 186 
ng errors in division (24 examples—15 minutes) 
the work below mark with a (c) every example that is solved correctly 
= with an (x) every example that is not solved correctly. 
m rl () 75114 ( ) 5518 ( ) 43 () 
26 23/1739 30/1668 83/3603 
0 | 5 161 150 332 
V or ae ae 2 Baa 
76 129 168 283 
75 115 160 249 
14 8 34 
bulary in division (14 terms—5 minutes) 

ing the example, answer the following questions. 

32r 

24/769 

72 

49 

. 48 
the Bet 
1 

Underline the correct response 
) VR 8 8 8 ee a = lh hUr ll 

2) The divisor is ..----- pqnenistiuniakarmettines ee YS TS Ce 

5) The quatient © <..cn2205----- iouinn ii iteaticaeamiianiactnlieaianiiaily 769, 49, 24, 32, 76. 
ty, 4) The Geel GURRIRIEE 9D cent meentrncnesweecessnnnssatn a & i m. 4. 
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The reliability coefficients of the screening test in two-figure division 
and the above tests measuring the specific arithmetical factors in two-figure 
division were computed by the split halves method and corrected by the 
Spearman Brown Formula.* The reliability coefficients ranged from 79 to 
98 with a mean reliability of .89. The time limits for the tests were set x 
the points where approximately 90 per cent of the pupils finished the tests 
These time limits as well as the reliability coefficients were determined by 
administering the tests to sixth grade pupils in a neighboring city who had 
recently completed the study of two-figure division. 

To compare the 90 excellent and the 90 poor achievers on the factors 
thought to be associated with ability in two-figure division the “t’’ test’ for 
the significance of the difference between two means was first used. How 
ever, since excellent achievers might do better than poor achievers, due t 
such factors as mental age and chronolgical age, it seemed necessary to com 
pare the two groups with the effects of these two factors ruled out. The 
correlation between mental age and ability in two-figure division was .51 
and the correlation between chronological age and two-figure division was 

31; both correlations were significant. To control the effects of mental 
age and chronological age the two groups were compared by use of the 
lohnson—Neyman technique.* By use of this technique the effects of the 
two matching characters mental age and chronological age were controlled 
statistically. This technique eliminates the necessity of adopting an indi 
vidual-for-individual matching technique. Another aspect of this is that it 
gives the range on each of the matching traits mental age and chronological 
age wherein differences between the two groups are statistically significant 


FINDINGS 


A comparison of the mean achievement of excellent and poor achievers 
on the general factors and specific arithmetical by means of the “t’’ test is 


(th 


shown in Table I. All “t’’ values shown in the table larger than 3.4165 (the 
001 level of significance)® are considered statistically significant, i.¢., the 


*Henry E. Garrett, Statistics in Psychology and Education, p. 315. New York 
Longmans, Green and Company, 1939. 

‘ [bid., p. 211. 

*Palmer O. Johnson and J. Neyman, “Tests of Certain Linear Hypothesis and 
Their Application to Some Educational Problems,” Statistical Research Memoir 
I (June, 1936), 72-93. 

*R. A. Fisher and F. Yates, Statistical Tables for Biological, Agricultural, and 
Medical Research, p. 26. London: Oliver and Boyd, 1938. 
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nce between the means of the two groups as the factor under con- 


1 


0 


that 


is a real and not a chance difference. Only one chance in 1,000 
a difference as large as, or larger than, the observed difference 


have arisen by chance sampling. It is evident from Table I that 
at and poor achievers differ significantly on all the general and spe- 
factors associated with ability in two-figure division. Even in the case 
ronological age the poor achievers are significantly older. Because the 


lent achievers are significantly superior to the poor achievers in mental 


nd chronological age, and because these two ages correlate significantly 
ability in two-figure division, these two criteria might be causing the 
rences in the other general and specific factors which favor excellent 
vers. However, when the effects of mental age and chronological age 


TABLE I 


DIFFERENCE BETWEEN MEANS OF EXCELLENT AND Poor ACHIEVERS 


STANDARD ERROR OF DIFFERENCE, AND “t” 
SELECTED Factors USED IN STUDY 


VALUES FOR 








fental age 

nological age 

lamental operations 
A, Reading 

ye C, Reading 
D, Reading... 

figure division. 

nating the first quotient figure 
g the first quotient figure 

tiplication as in division 

traction as in division __- 

paring product and partial dividend 

ling errors in division... 


abulary in division - - -itbnoshemeeense . 
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re statistically controlled by use of the Johnson—Neyman technique, the 


lifferences on all factors with the exception of the three reading tests still 
significantly favored the excellent achievers at the one per cent level of 


probability. 


The Johnson—Neyman technique showed that excellent achievers in 
division were significantly superior to poor achievers in division on the fol- 
lowing factors when excellent achievers possessed, in general, the specified 


mental ages and chronologica! ages: 
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Mental Age 


i. 


| Age 





months 
One-figure division el 109 to 186 123 
Estimating the first quotient figure 109 to 199 123 
Placing the first quotient figure 109 to 158 130 
Multiplication as in division o 109 to 169 123 3 
Subtraction as in division... , 109 to 192 130 t 
Comparing product and partial dividend. _..........-- 139 to 162 130 t 
Finding errors in division. 130 to 199 23 12 
Vocabulary in division... .- : aielalaieial 109 to 157 130 49 
Fundamental operations. _. ' aes 109 to 191 123 
| 
For example, in one-figure division, it may be said that, in genera 


pupils, who have mental ages of 109 to 186 months and chronological! 
of 123 to 153 months, may be expected to do significantly better i: 
figure division if they are excellent rather than poor achievers, and sig 
nificantly poorer if they are poor rather than excellent achievers. In all 
several of the above listed factors nearly all excellent achievers were sig 
nificantly superior to nearly all poor achievers. In no factor were ther« 
poor achievers that were significantly superior to excellent achievers 
range of mental ages and chronological ages is so wide that differenc 
favoring excellent achievers hold for nearly all achievers of this type at 
sixth grade level 

EDUCATIONAL IMPLICATIONS 


Certain implications for instruction and diagnosis in division sug 
themselves. The implications presented are based largely upon the finding 
of the study, and in small part upon the writer's personal experiences. P 
sible causes of disability in two-figure division are here presented with the 
educational implications. 

Poor achievers showed a marked disability in the process of two-fis 
division. The truth of this statement is shown by the fact that in the 
example screening test in two-figure division the mean score for the 
achievers was only 5.18. Considering that these pupils had completed 
study of two-figure division, such poor achievement is not to be expect 
This lack of success is most likely due to many causes. The fact that exc 
lent achievers were significantly superior to poor achievers in ability in t 
general factor, fundamental operations, and in all of the specific arithmetic 
factors in two-figure division, when mental age and chronological age we 
statistically controlled, suggests that this lack of success may be due part 


to inability in these factors. 
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ferior ability in estimating the first quotient figure, in placing the 
otient figure, and in comparing the partial dividend and the prod- 
ear to be caused by a lack of understanding of the division process. 
ick of understanding, may be in part due to such factors as inade- 
tial teaching of two-figure division, lack of individualized instruc- 
k of proper diagnostic and remedial instruction, use of methods of 
tion which fail to stress meanings and generalizations, and the bunch- 
ill types of two-figure division examples in a single grade instead of 
: types through several grades. 
ro [t is evident further from the findings that poor achievement in two- 
" % livision is also due, in part, to an inadequate mastery of one-figure 
n, multiplication, subtraction, and vocabulary terms used in division. 
in these four factors implies the need of a more adequate readiness 
for two-figure division. For, if one experiences difficulty in one- 
livision, certainly two-figure division will be even more difficult to 
Since an error in either multiplication or subtraction will result in 
rect quotient, an incorrect final remainder or both, an adequate 
nd in these two processes is also an essential prerequisite to the 
two figure division. A desirable way to eliminate errors in mui- 
tion and subtraction is to practice multiplication and subtraction in 
and not multiplication and subtraction, per se. In other words, 
n should be taught as a complete process and not as an assemblage 
gs rete entities. Since vocabulary terms in division are employed in the 
P ing of division an understanding of the meaning of these terms ts 
ier readiness factor worthy of consideration. The meanings of many 
these terms could be mastered when one-figure division is taught. Addi 
training in the use of vocabulary terms in division could be made 
attractive and more understandable by employing vocabulary exercises 
1 games in conjunction with the working of examples in two figure 
Vision 
Ability to find errors in division examples is another factor which sig- 
intly favors the excellent achievers. Disability in this factor appears to 
partially associated with poor achievement in division; therefore it seems 
lvisable to employ as a teaching technique, exercises in which pupils are 
ven the opportunity to find errors in division. Exercises in finding errors 
iy be supplied by the teacher, or pupils may locate their own errors, or 


errors made by other pupils. 
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Since the pupils in this study, in general, possessed an interest and , 
favorable attitude toward testing, it seems that the testing technique might 
be used more frequently as a means of checking achievement and diagnosing 
pupil difficulty. It is possible also that achievement in two-figure division 
might be improved by encouraging pupils to check their computations 
occasionally and to do neater, more orderly work. 


PROBLEMS SUGGESTED FOR FURTHER STUDY 


Several problems suggest themselves as being worthy of further 
investigation, as follows: 

1. It would seem to be of great value and vital interest to find out if 
other factors, such as the following, distinguish excellent and poor achievers 
in division: physical factors including hearing, vision, motor coordination, 
handedness, and general physical fitness; environmental factors, such as de- 
liquency, home background, parental attitude, and pupil's use of leisure 
time; and factors inherent in the pupil's personality, including emotional 
tone, attitude, interest, persistence, initiative, and the like. 

2. Of importance also would seem to be a study to discover if certain 
differences between excellent and poor achievers tend to be retained for a 
considerable time after instruction had ceased. 

3. A study similar to the present investigation comparing excellent, 
average, and poor achievers in division with one-, two-, three-, and four 
figure divisors and quotients would seem also to be of value to teaching 
and diagnosis in division. 

4. The possibility of sex differences in certain factors associated with 
ability in division might also be worthy of further study. 


5. Comparisons of excellent and poor achievers under different methods 
of instruction, when practice and learning materials are varied, and when 
different plans of gradation of types of division examples are employed 
would also be of great educational value. 
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ANALYSIS OF LETTERS OF APPLICATION WRITTEN 
BY PROSPECTIVE TEACHERS 


PHit C. LANGE 
University of Wisconsin 


Editor's note: The analysis of letters of application written by students 

lled at the University of Wisconsin may have implications for other 
icher training institutions as well as Wisconsin. 
AS PROSPECTIVE teachers approach the conclusion of their training 
ram, they are faced with the problem of securing employment and 

ordinarily involves the writing of letters of application. For some of 

prospective teachers this may be their first business letter. Many of 
se letters are not as effective as they should be. The purpose of this paper 
to present an analysis of 93 such letters written by prospective teachers 

-» University of Wisconsin. An attempt will be made to answer the 
lowing questions: (1) what do teacher applicants include in their let- 
rs? (2) what do they emphasize? (3) what is the manner of presen- 
on? (4) how well do the letters conform to letter-writing standards? 

(5) are there group differences in letter-writing abilities? 


PROCEDURES 


The 93 application letters summarized in this report were written by 
} prospective secondary school teachers enrolled in three education classes 
f 22, 30, and 41 students, respectively. (See Table I.) 

In each class it was agreed that three of the applicants should be 
elected for personal (mock) interviews on the basis of the application 
etters. A mimeographed copy of the rules, assumptions, references, and 
plan for selecting interviewees was given to each class member. Each stu- 
lent was to write a solicited application for any position for which he was 
jualified. He was to assume that his credentials had already been sent by 
the University Teacher Placement Bureau and that he had been informed of 
the opening by that bureau. In one class (41 students) data sheets were 
permissible and in two classes (52 students) they were not. Letters were 
to be written in longhand, and limited in length equivalent to a one-page 
typewritten letter. Each student was advised to exercise good judgment in 
selecting the most effective content for his particular letter and to be 
especially careful of the organization, appearance, form, and mechanical cor 
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TABLE I 


TABULATION BY CLASSES OF THE TEACHING MAJORS AND MINoRrs 
OF THE PROSPECTIVE TEACHERS* 





Majors | Minors 
| } 


Subject Area 
N =22 | N=30 | N=41 | Total =93 |} N=22 | N=30 | N=4l 


Language. | & 1 =| 2 | 35 | 44 21 | 26 
Social Studies | 6 2 oe 17 || 6 10 17 
Home Economics 2 3 j 7 12 0 0 0 
Music 1 3 | 5 9 0 0 0 
Art Education 2 1 | 0 | 3 0 | 0 

Phy. Ed a 0 4 3 7 0 l 1 
Agricultur: 2 2 0 4 1 0 0 
Sciences 4 | a 2 10 6 | 10 19 
Math 1 2 1 4 4 2 3 





* Eight students have double majors, and over half of the students have double minors. 


rectness of his letter. Each class had at least a week's time in which to px 
pare a letter. Articles, guides, references, and bulletin board material 
interviewing and letter-writing were made equally accessible to all class 
Upon being collected, the application letters of each class were 
to three superintendents and interviewers (graduate students with ad: 
istrative experience) who independently ranked the letters on the basis 
their “general appeal.” Every precaution was taken to have applicants 
lected on the basis of their letters only. The writers of the three top-rank 
letters in each class were interviewed during the regular class period as | 


* The following references, among others, were especially recommended: 

The Business Letter and Its Structure’ in R. R. Aurner's Effective Engli 
Business, N. Y.: South-Western Publishing Company, 1935 

Professional Growth and Personal Advancement” in Raleigh Schorling’s Stud 
Teaching, N. Y.: McGraw-Hill Book Company, 1940 

“Which Letter Gets the Job” by Frank G. Davis in School Executive, May, 1 

“Many Teachers Don’t Know How to Apply for Jobs’ by A. C. Jensen 
Clearing House, May, 1940 

Placed on the bulletin boards were (a) descriptions of the services of the | 
versity Teacher Placement Bureau, (b) copies of applicants’ credentials sent out 
administrators by the bureau, (c) a list of questions asked and frequency with whi 
they occurred in the application blanks of 70 high schools in Wisconsin employ: 
20 or more teachers, (d) typewritten copies of ‘suggestions’ edited by several pla 
ment bureaus, (e) the full article, ““Which Letter Gets the Job” (see above), an 
(f) a list of additional references 
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LETTERS OF APPLICATION 


ial class discussion of interview technique. The analysis of letters for 
t, form, and errors was not begun until after the ranking and inter- 
¢ had been concluded. 
lowing the interviews the letters were analyzed first for content, 
emphasis, then for acceptable format, and finally for mechanical 
mposition errors in the body of the letters. Three readers independ- 
nalyzed each letter for content and emphasis. Errors in format and 
echanics of composition were scored independently by two experienced 


eaders—one an experienced teacher of English, and the other a college 


r majoring in journalism, 
Questionable usage and punctuation practices were scored as errors 
they were inconsistent with practice elsewhere in the letter. 


oth readers acknowledged an error, it was not tabulated. 


FINDINGS 


tent. There was a marked difference in the content of those letters 
by the 41 students in the class where data sheets were permissible, 
se written by the two classes where data sheets were not permissible. 

ants who could not attach data sheets were very much limited in the 

in which they could emphasize special training or ability. Table II 

the contextual differences of the letters of the two groups following 

rent instructions; and the proportion of men and women students who 
tioned the respective types of information. 

Points of emphasis seem to show genera! differences; but these differ- 
es are more quantitative than qualitative, and are very likely attributable 
the presence or absence of a data sheet. In those letters not attaching data 
ets, names of persons for reference were given more space than any 

ther single item, with extracurricular activities and abilities second in 
iportance; whereas, in letters to which data sheets might be appended, 


ws 


the primary emphasis was on out-of-class experiences, unusual preparation 


nd special abilities of the applicant, philosophy of education or function 

teacher, and the employment history of the applicant. Except for the 
casional emphasis on philosophies among the letters of one class (‘The 
School and Society”) and the emphasis on unusual preparation which was 
haracteristic of the letters of all music majors, the differences in emphasis 


were primarily individual variations. 
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[he proportion of students in each class who indicated or implied 
to handle additional duties was approximately the same. Some appli- 
vaguely stated they could “handle (or manage) a club” while others 
specific duties—one girl naming 13 extracurricular activities that 
ild supervise. Table III shows the percentage of students who indi- 
their abilities to contribute to various school functions in fields other 


heir specialties. 


TABLE III 


A List OF THE EXTRABILITIES* OF THE 93 APPLICANTS AS STATED 
IN THEIR APPLICATION LETTERS 








Proportion of applicants stating ability 


Nature of Ability | 55 Women 88 Men Total—93 

f % f | % f 

—_ 
aching 8 | 15 CO 11 es at 19 | 20 
k directing 11 | 20 4 11 15 16 
i 2. 2 aoe en. oe 
atics 13 24 8 22 21 | 23 
sics 7 13 | 5 14 12 13 
1 6 11 3 8 | 9 | 10 
iry management 8 15** 0 0 | x | 9 
rary society 7 13 > o | 7 | » 
nstrumental : | 10 19 8 22 «| is | 19 
, vocal 7 13 5 4 / 12 | 18 
ational experience ; 15 28 10 27 | 25 27 
ations 10 19 3 8 is | 14 
broadcasting 0 0 | 3 8 3 | 3 
ynal management 4 8 6 16 10 11 
hwork (experienced in)- 11 20 2 6 13 14 
edial reading | 5 9 2 6 7 8 
eadership 5 9 5 14 10 11 
i! affairs (managing 5 9 | 8 22 13 14 
al work (experience in 3 6 | 2 6 5 5 
lent council (advisor to 7 13 | 3 8 10 11 
fic Club 2 4 0 0 2 2 
MCA, YWCA 7 13 3 8 10 11 


* Extrability is used here to refer to an applicant’s ability to conduct out-of-class activities that 
t directly a part of his fields of specialization. Thus the ability to direct an orchestra is an extra- 
ility for an English instructor, but not for a band director. Consequently, the music abilities and the 
thletic abilities of the music majors and physical education majors, respectively, are not included in the 
ibulations for extrabilities in music and athletics, respectively. 
** All are English majors. 


Organization and Presentation. In general the first paragraph intro- 
luced the applicant. A composite first paragraph would read: 


I have been informed by the University Placement Bureau that you 
have a vacancy in (special subject field). I should like to be considered an 
applicant for that position. 
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A composite last paragraph would read: 


I should be very happy to supply you with any additional infor 
or to make arrangements for a personal interview. You may reach 
(address or phone). Any consideration will be appreciated. 


The variety of information in the middle paragraphs is illustrat 
[able IV, which shows the location of information in the paragray 
the 41 letters of one class. 

The median number of paragraphs for all classes and groups 
classes was slightly less than 5, the range being 2 to 10. One letter « 
19 lacked ideational unity in paragraph division. 

With but slight variation among classes, the proportion of dif 
sentence types was: simple—60%, complex—25%, compound 10% 
pound-complex—4%, and sentence error—1%. 

The first sentence began with J in 469% of the letters. 

The typical contents of the last sentence and ratios of appearance 
request for interview—29%; how to reach applicant—29% ; “hoping 
hear from you soon, (I remain)""—14%; appreciate consideration—1 
additional information will be forwarded—7%; others—9%. 

Six of the letters had a “cocky” approach, including such remarks 
(1st sentence) “note my address, for you will need it once you read 
papers’; “If your conditions of employment are harmonious with minx 
am sure we can reach a mutual understanding’; “I can give your fac 


the enthusiasm it needs’; ‘My papers speak for themselves”; etc. 


Ten letters had very weak sentences in the first paragraph: “. . . so | 
thought I should write’; ‘thought maybe you would be interested” ; 


if you can find room for me” ; etc. 

In 40 letters the applicants used questions, such as: “would you like 
ski team?’’, “will you inform me when the position is filled?’’, etc. 

As to the effectiveness of the letters, the experienced administrato: 
who ranked the letters on the basis of “general appeal” classified only 
out of the 93 letters as ‘worthy of careful consideration.” In one case t 
of the three interviewers agreed that one class had not submitted even 0: 

really good letter. 


The median and the ranges of the rank values assigned by the inter 


’ 


viewers on the basis of “‘letter appeal’’ were approximately the same fo 
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men and women students. No one group distinguished itself as measured 


by this standard of effectiveness. 


Contrary to expectation, the letters of the 20 language majors in the 
class of 41 had a median rank value slightly lower than the letters of the 
remainder of the class; the same was true of the letters of the 23 wh 
majored or minored in English. 

Letter-Writing Format and Mechanical Errors. In letter-writing skil| 
all three classes were equally poor, evidencing poor word usage, poor pur 
tuation, carelessness in detail, and little regard for letter-writing forn 
lable V pictures the extensiveness and range of errors throughout the parts 
of the Jetters. Almost 90% of the letters had errors in the format alone 
85% had errors in the body of the letter, and 94% had errors either in the 
format or the body. 

Only 6 of the 93 letters were entirely free from mechanical errors 
The number of errors per letter ranged up to 39 in one letter, with the 
median at 14. There were no sex differences, except for the more numer: 
misspellings per letter in letters of women applicants. The median err 
per letter for the 38 language majors was 12; only 3 language majors 
wrote errorless letters, and an English major wrote the worst letter 
errors 

Most frequent errors in the headings were the use of abbreviations 
the failure to use consistently either open or closed punctuation. One-fift! 
of the letters are inconsistent in using block form for the heading and 
dented form for the inside address, or vice versa. One-fifth of the lett 

omitted from the inside address the Mr., the school official's title, or bot! 
In 8 letters, Principal or Superintendent was misspelled in the inside 
dress. Most frequent error in the salutation was the use of a comma inst 
of a colon 

In the bodies of the letters, the most frequent errors were in punctua 
tion. There was one comma error to 10 commas used correctly. The ap 
trophe mark was used incorrectly more times than correctly. Some students 
used the dash as an “all purpose” punctuation mark. Quotation marks wer 
ised correctly by 3 students, incorrectly by 7. 

Tabulated under errors in diction were: wrong words, colloquialisms 

slang, ambiguities, redundancies, lack of number agreement, etc.—liste 


here in order of frequency. ‘Glasses are my only physical defect” was scored 
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as an error in diction—wrong word. ‘Faculty staff’ was scored 
dundant. Although three-fourths of the letters did not follow the pr 
scriptive usage for “should” and “would” and “shall” and “will,” failures 
to make the prescriptive distinction were not tabulated as errors. 

Capitalization errors in the bodies of the letters were restricted almost 
entirely to the mame of the subject area fields. These errors included not 
only capitalizing Aistory, mathematics, etc., but also putting im lower case 
the titles of languages, English, Spanish, etc. 

The most surprising errors were the misspelled words. (End-of-li: 
hyphenation errors were tabulated under hyphenation, and never tabu! 
among the spelling errors.) Slightly over half of the letters had one 
more misspelled words, and there was a total of 73 different words amy 
the misspellings. The following words were misspelled in three or more 
letters: accommodation, athletics, Bachelor, believe, convenience, curriculun 
dramatic (adjective), eligible, experience, extracurricular, it’s, mathemati 
preparation, Principal, privilege, received, respectfully, similar, sincerei 
Superintendent, too, your. The language majors had as many misspellin; 
per letter as any other subject area group. In two of the classes wome 


n 


students misspelled almost twice as many words per letter as did the met 





students. 

Regardless of the fact that the interviewers said some letters were 
poorly written to be given consideration, there was only slight relationshi; 
between the mechanical correctness (number of errors) of the letters a 
their rank values in “letter appeal,” the coefficient of correlation beit 

43 + 06. 

The most frequent form of complimentary close was ‘‘Sincerely yours 
appearing in one-fourth of the letters. Twelve other forms were used, ran 
ing in formality from ‘Most respectfully yours” to “Yours” and “Sincerely 

This failure to conform to acceptable letter format and recogniz - 
standards of composition becomes even more astounding when one remen 
bers that each class was warned against these errors and were supplic 
with helpful materials he 

Letter-Writing Procedures, Student Attitudes, and Results. Because tl sta 
letters contained so many very obvious errors, it seemed advisable to de 


termine whether these letters were representative. To this end, prior to th - 
interviews, all students answered questions bearing on method, content, em 1 
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ind writing skill. On the basis of their responses it appears reason- 
. say that these letters are indicative of the letter-writing abilities of 
prospective teachers. 

Eighty-seven applicants claimed to have written a “good letter’; the 

ining six explained that they “never could write a letter.” These same 

ipplicants were the only ones to say that they did not know how to solve 
mposition problems. 

In all cases the letter submitted was a final copy, revised from one or 
rough drafts. Ninety-six percent of the applicants personally proof- 
the letters that they submitted, and 44% secured the help of another 

Forty-six applicants, including the six whose letters were mechan- 
orrect, referred to some authority, text, or manual. 

All of the writers said that their letters contained no spelling errors. 

y 50% said that their letters were entirely free from any mechanical 
30% expressed doubt, and 20% said there probably were errors. 
one student estimated his maximum total errors as more than five. 
writers said that their respective letters had acceptable format. English 
language majors were relatively more confident about the correctness 
their letters. Three-fifths of all applicants stated that letter-writing was 
hore or problem for them. Two-thirds of the students said that their 
ters were not a good indication of their writing ability, and half of these 
lents took the position that an application letter could not adequately 
writing ability. 

The number of errors tabulated and the rank values assigned to the 
spective letters did not reflect the differences: (1) in having or not hav- 
g a helper, (2) in being or not being confident about correctness, or (3) 
, being or not being satisfied with the letter. Reference to a text or manual 
is the only writing practice that apparently resulted in slightly higher 
inking for “letter appeal” or in fewer errors per letter. 

As to the value of data sheets, over four-fifths of the students in 
ich class expressed the opinion that the data sheet was an aid both to 

he applicant and to the employer; and all expressed interest in having a 


standardized one-page data sheet for teacher applicants. 


Of particular interest are the individual responses to two questions, 
1amely: (1) “What in, or about, your letter is most likely to gain the 
lministrator's favor and win the job for you?” (2) “What do you con- 
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TABLE VI 


A TABULATION OF THE SALES TALK AND THE SELLING POINTS 
OF 93 TEACHER APPLICANTS* 


| Applicants Mentioning 


Most effective | As best 
Item or Quality Mentioned part of letter selling 








Extracurricular activities 20** 22 11 12 
Scholastic preparation 19 20 10 
Writing ability, as evi P 11 12 0 
Statement of philosop! ds 9 10 0 
Reference list, recom men< « a 6 
Employment experiences 7 8 19 
\nusual interest in speciai feild 5 
‘iability (a “liking for people” 5 3 14 
Versatility in special field 3 3 
Knowledge of small town ; 3 7 
Personality l l 8 
Undecided 0 4 
Miscellaneous { 4 3 
* This table tabulates the responses to two related questions: (1) What in, or about your 
most likely to gain the favor of the administrator and win the job for you? (most effective 
letter); (2 hat d 1 cor selling point in getting a teaching position? 
** This table read 4 of the applicants listed extracurricular activities a 
at I ant pa f listed extracurricular activities as their best sellir 





1g F 
sider your best selling point in getting a teaching position? Table VI | 
ures the group responses to these two questions on effectiveness. In 
swering these two questions only one applicant out of each three li 
the same quality or item for both questions. Approximately one fifth of 


applic ints had not mentioned their “best selling point’ in their lett 
especially was this true of those whose best selling point was persona 
or ability to get along with people. Only one-third of the applicants 


special emphasis in their letters to what they stated as their best points 


CONCLUSIONS 


1. The 93 prospective teachers studied in this investigation ar 


agreed upon what kinds of information should be common to all solicit 
application letters. They are agreed that a data sheet is a helpful suppl 
ient to the actual letter. In this study, the presence of a data sheet has 

sulted in greater space and emphasis given to special abilities and philos 


phies, and in the Omission Of abbreviation of personal data and education 


histories 
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skill in communication shown by future teachers is not flatter- 
profession—least of all, to the teaching profession. 

letters analyzed indicate an ignorance of acceptable forms in 
respondence. 
ny of the applicants did not emphasize in their letters what they 
be their best selling points. 

prospective teachers herein studied were surprisingly unaware 


tations in written communication. 


hort, this study has shown that these 93 prospective secondary 


har 


hers—and probably others like them—are not agreed on what 


nformation in a letter of application, frequently omitting pertinent 


misplacing emphasis. They are surprisingly ignorant of composi 


lards or are in practice incapable of conforming to them. 














A COMPARISON OF CERTAIN PERSONALITY CHARACTERISTICS 
OF MENTALLY SUPERIOR AND MENTALLY 
RETARDED CHILDREN 


WILLIAM MCGEHEE 


Department of Psychology 
State College of the University of North Carolina 
Raleigh, North Carolina 


W. DrayTon LEwis 


Department of Education 
Murray State Teachers College 
Murray, Kentucky 


Editor's note: The authors present data from which they conclude 
that pupils of superior intelligence enjoy better personality development 
than pupils of inferior intelligence. 

THE majority of investigations of the nature of the personality traits of 
exceptional children have suffered from either a lim:ted number of subjects 
as in the study of Laycock (3), or from being confined to a rather narrow 
geographical area, as in the studies of Terman (9), Nifenecker (6), and 
others. These two limitations do not invalidate the results of these investiga 
tions but do suggest the value of investigations involving large numbers of 
subjects drawn from a wide geographical area. It is the purpose of this 
study to present the results of such an investigation of certain personality 
traits of mentally superior and mentally retarded children. 

The subjects of this study, 4797 boys and 4264 girls, are drawn from 
46 states, 310 communities, and 455 schools in the United States.* The 
mentally superior group are the children, from a population of approxi 
mately 50,000 in grades four through eight, who scored in the highest ten 
per cent of the group in terms of intelligence quotients based on the 
Kuhimann—Anderson Tests. The retarded group are those children who 
scored in the lowest ten per cent of the same subject population on the 
Kuhimann—Anderson Tests. The intelligence quotients in terms of per- 
centiles of the population from which the subjects of this investigation are 
drawn are given in Table I. 

Two measures of personality have been used in this investigation. Onc 
measure is the P-score on the B. P. C. Personal Inventory (2). Three scores 





* The subjects are a part of the population involved in the Coordinated Studies 
in Education. The writers express their appreciation to this group for the use of the 
data on which this investigation is based. 
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TABLE I 
[INTELLIGENCE QUOTIENTS IN TERMS OF STATED PERCENTILES OF THE 
CHILDREN IN GRADES FouR THROUGH EIGHT 
| Grade Grade Grade Grade Grade 
4 5 6 1 8 
—E —_ — — = — 
116.8 115. 5 116. 6 118. 6 115.0 
| 101. 8 100. 1 101. 6 101. 6 99. 3 
82.2 81. 0 82. 8 86. 1 86. 7 
-| 10, 280 8, 939 10, 187 8, 193 7, 944 
| 

















computed from this inventory, but it was not considered necessary to 
three scores since the correlations between the three are high. One of 
present writers, for example, has found correlations between S and P 
; of .83 for boys and .85 for girls at the sixth grade level. Moncreiff 
reports correlations ranging from .80 to .95 at the seventh and eighth 
ide levels between S and P, and the C and P scores. Other investigators 
) (7) have found equally high correlations. The second measure of 
ality herein considered consists of teachers’ ratings of their pupils 
he presence of 70 designated personality traits. The following instruc- 

; for making the ratings were given the teachers: 


[here are two columns just beneath this. In the one to the right there 

70 personality traits or general characteristics. Study these points care- 

lly and in the large blank (left) column put the numbers of the traits 

r characteristics which are MOST descriptive of each child in your estima- 

tion. You can pick out at least 5 of these for almost any child; you prob- 

ibly should not pick out more than 10 or 12. Be sure to rate each child and 

e sure that all characteristics noted for each child are outstandingly 
lescriptive of him. 


No significant or consistent differences in either the B. P. C. Personal 
Inventory or in the teachers’ ratings are found between the various grade 


levels. The writers, therefore, have combined the data from the various 


grades and have made comparisons between all the subjects in the superior 
ind the retarded groups rather than between the groups at each grade level. 


Percentiles of the P-scores of the superior group and of the retarded 
roup are given in Table II for grades five through eight. Data on grade 


four for this inventory are not used as it is believed that the language difh- 


ilty of the inventory is too great for children at this grade level. Further, 


Pl ee 
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TABLE II 


A COMPARISON OF THE B. P. C. PERSONAL INVENTORY P-SCORE OF THE SuprErios 
AND OF THE RETARDED GROUPS IN TERMS OF STATED PERCENTILES 
AND QUARTILE DEVIATIONS* 





Superior Grout Retard 
Boys Girls Boy 
P90 54. 06 51. 47 69.13 
rio 41. 4 38 6. 6 
P 29. 50 27. 42 14. 00 { 
P2 20. 3 18. 06 $2. 82 
l 12. 37 11. 42 23. 61 2 
0. 58 1 } R9 
) 10. 22 2 
1286 18 ) 
*Higher the score, the greater the maladjustment 


the number of personality test records available at this level are much 
than those at the other grade levels in this investigation. 
It is obvious from the data presented in Table II that the retarded gr 


as a group, shows more maladjustment than the superior group. The me 





of the _etarded group are greater than those of the superior group, 


these differences are all statistically reliable. Further, it should be 
that the tenth percentiles of the retarded group are higher than the tw 
fifth percentiles of the superior group and that the medians of the ret 
group are higher than the seventy-fifth percentiles of the superior group 
The second type of data on the personality of the subjects in the pr 
investigation, as stated previously, is teachers’ ratings of these children on 
personality traits. The traits which were rated five are grouped in Table III 
those rated four in Table IV, those rated three in Table V, those rated 


in Table VI, and those rated one in Table VII. 
The numerical rating of each trait represents the composite judg 
of 50 mental hygienists. These judgments were secured by means of a q 


tionnaire which was sent from the Jesup Psychological Laboratory, Peabo. 


College, to 95 members of the American Psychological Association, ch 


it random from those members who were listed in the directory of 


ussociation as being actively engaged in clinical or hygienic work. I 


questionnaire was filled out and returned by exactly fifty of those to wh 


it had been sent. The directions for rating the traits listed in the questi 


‘ 


naire were as follows 
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Below you will find 70 personality traits or characteristics which at 
ire descriptive of certain school children. Please consider each of 
from the standpoint of a mental hygienist. In other words, evaluate 
point in terms of its significance and relation to the present and future 
health of the child. If you think the presence of a particular trait 
cided or definite hygienic value, put a 5 in front of the trait in ques 
If you think the trait has some hygienic value, but not as much as 
ther, put a 4 in front of it. If, in your opinion, a trait is neither 
ularly desirable nor undesirable, score it 3. A trait which probably is 
sirable or harmful, score it 2. If, in your opinion, a given trait is 
and unequivocally undesirable or very harmful to the mental 
f a child, score it 1. You may duplicate a given score as many times 
wish 
{ composite score for each trait was computed by securing the mean, 
and mode of the values assigned to each trait by the 50 raters. 
e three measures coincide in the case of many traits and on none of 
ts were they separated by as much as one point. The rating of each 
lerived from the values of the mean, median, and mode of the trait 
esented by a whole number nearest to the value of all three of these 
es. Trait 30, for example, received a mean value of 3.8, a median 
and a modal value of four. Following the procedure just 
the trait was assigned a value of four. In other words, this trait 
which, in the judgment of mental hygienists, has some value, but not 
h as some other traits, from the point of view of the mental health 
hild. Eight of the 70 traits received a rating of five, 11 a ranking 


nine a ranking of three, 37 a ranking of two, and five a ranking 


TABLE III 
ARISON OF THE PERCENTAGES OF SUPERIOR CHILDREN AND OF RETARDED 

CHILDREN ASSIGNED TRAITS WHICH HAVE DECIDED HYGIENIC VALUE 
Superior Retarded 

Boys Girls I 5 Girls 

48.0 62.4 16. 7 20.6 

43.6 48.0 17.3 17.9 

44.6 49.6 26. 1 26. 4 

39. 0 12.6 23.1 25. 0 

t 25. 4 16. 7 12. 5 7.3 

31.8 28.2 2.4 1.3 

i 9.3 12. { 2.9 4.7 

16. 6 19.3 2.9 & 

1854 2676 2943 1588 




















604 JOURNAL OF EDUCATIONAL RESEARCH {Vol. 35, No.8 


TABLE IV 


A COMPARISON OF THE PERCENTAGE OF SUPERIOR AND OF RETARDED CHILDREN 
ASSIGNED TRAITS WHICH HAVE SOME VALUE FOR MENTAL HEALTH 


Superior } Retarded 

Trait ———|-_——_ - —|— 

Boys | Girls Boys Girls 

——— aes 

Adventuresome 2.4 | ws | 7.7 8 
Ambitious 45.3 57.1 | 6.9 9.9 
Artistic 13. 9 24.1 | 4.7 7.3 
Energetic 28.6 28. 7 17. 5 10. 7 
Generous 17.7 22.2 12.2 16. 1 
Investigative | 244 13. 6 a. | 2.2 
Leader 16. 1 20. 2 | $2 | 28 
Persistent 17. 5 20.2 7.6 7.8 
Polite $8. 5 48. 1 26.1 $2.7 
Precocious 16. 7 15. 7 .4 
Systematic 6.5 10. 7 1.1 2 
N 1854 | 2676 | 2943 1588 





The percentages of subjects in the superior group and in the retarded 
group which were assigned each trait by the teachers were computed and 
are shown in Tables III-VII. Percentages for each grade level are not giver 
since no reliable or consistent differences in percentages of traits assigned 
were found between the five grades in this investigation. The traits in thes 
tables are not listed in the numerical order in which they appeared on the 
original record sheets used by the teachers in making their ratings; rath 
they are group according to the ratings assigned the traits by the ment 
hygienists. 

TABLE V 


A COMPARISON OF THE PERCENTAGE OF SUPERIOR AND OF RETARDED CHILDREN 


ASSIGNED TRAITS WHICH ARE NEITHER DESIRABLE NOR UNDESIRABLE 
FROM A MENTAL HYGIENIC VIEWPOINT 


Superior | Retarded 
Trai - _—,— -) - 
| Boys | Girls | Boys Girls 
Disturbs Class 10.4 4.0 18. 7 | 6.3 
Domineering 4.5 4.0 5. 0 1.7 
Sex-Conscious | 0.9 1.2 3.2 5.6 
Sympathetic | 3.5 3.1 3.2 7.1 
Talkative 8.2 7.5 8.4 8.0 
Tidy 26.3 40. 0 11.2 | 18.9 
Uses Tobacco 0.7 .003 | 7.4 | .5 
Whispering 5.7 8.1 10.7 | 12. 6 
Writes Notes | 0. 1.3 6 | 3.8 
N 1854 2676 «=| 2943 «8©| = 1588 
/ ' ' 
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is apparent from examining Tables III and IV that every trait rated 
ntal hygienists as being conducive to mental health is assigned to a 
percentage of superior subjects than to retarded subjects. The differ- 
re, in most instances, large; all of them meet the commonly accepted 
criterion of statistical reliability. The superior group then, as a group, 











ses, in terms of teachers’ judgments, more desirable personality traits 
3 oes the retarded group. 
7.3 When the traits designated by mental hygienists’ ratings as undesirable 
6.1 VI and VII) are studied, it is again apparent that the mentally 
2.3 
> : TABLE VI 
2 COMPARISON OF THE PERCENTAGE OF SUPERIOR CHILDREN AND OF 
. RETARDED CHILDREN ASSIGNED TRAITS WHICH ARE PROBABLY 
DETRIMENTAL TO MENTAL HEALTH 
arde Superior Retarded 
| and Boys Girls Boys | Girls 
PIV | 
ng 1.5 1.8 7.8 7.8 
g et 9.1 3.5 11.3 3.9 
. reaming | 11.5 6.8 23. 0 20. 4 
thes yeti 1.4 0.3 | 4.0 | 1.1 
ed 2.1 1.2 7.7 3.6 
1 the 1.4 20 86| 649.8 51.4 
ng .o2 | OT | 7 .2 
+ -G 1.0 1.2 . 1.4 
ure 4.8 | 3.8 4.5 4.9 
pr atient 3.7 4.0 | 5.2 | 4.1 
- 10u8 6.3 4.6 6.2 4.6 
entive a 8.0 4.5 i 33. 5 22.9 
rular in school attendance 1.4 1.1 | 11.5 | 11.6 
f interest 4.0 2.6 $0. 5 | 23. 8 
ete. 4.0 1.5 19.3 10. 7 
g . 03 | .5 2.7 | 2.3 
DREN 18, ete. 6.7 7.0 8.9 11.4 
r-critical 3.2 | 0 2.1 2.4 
sical cowardice 1.8 0.6 2.6 | .8 
iting, ete. 2.7 | 2 6.2 6.9 
fane; obscene 5 . 007 2.3 5 
arrelaome 1.5 | 0.9 6.0 3.5 
quitter”, etc. 2.0 1.5 9.3 | 6.4 
e, ete | 0.4 49 | 2.3 
fish; “spoiled ” 27 «| 2.6 20.) | 2.5 
; go-centric 3.6 | 4.0 | 5. 5 5.7 
ly _- | 15 | 5.6 | 4.3 
ssy 1.4 | 0.6 | 9 | .9 
enly; ete. 2.5 1.1 11.5 5.8 
ealing 2 | oz 1.0 | 1.0 
ibborr 2.1 1.2 7.8 2.8 
iggestible, ete. 2.6 1.3 7.1 6.9 
vicious 0.7 0.7 2.6 1.9 
rdiness, etc. 1.6 1.0 | 4.8 | 5. 0 
mper tantrums .8 | 6 2.5 j 1.9 
easily frightened 1.1 9 | 1.6 3.5 
: ruant ~ . 005 . 007 | 1.9 .3 
N 1854 2676 2943 1588 
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TABLE VII 
HE PERCENTAGE OF SUPERIOR CHILDREN AND OF RETApR 
NED TRAITS BY TEACHERS WHICH ARE UNEQUIVOCAL! 
HARMFUL TO MENTAL HEALTH 
Sur r Re 

i s Girls Boys 

0 03 

l | 1 & ~ 

1.6 10 

1. ( 2.4 

1854 2676 2943 


ilso superior in personality As seen in Table VII 
greater percentage of the retarded group than « 
signed all the traits rated as nequivocally har 
yssible comparisons in Table VI, the superior gr 


the retarded group in only eight instances. These diffe: 


ind 


ences are all small ; in no instances are they statistically reliable. In 
other 132 comparisons, the percentage of the retarded group exceeds 
percentage of the superior group assigned traits which are “probably detri 


to mental | 


these 132 differences are statisti 


ot 


ntal ygziene Forty e 

eliable 
In the case of traits which are neither desirable nor undesirable f: 

mental health viewpoint, no definite tendency exists for teachers to ass g 
a greater percentage to either group. It is interesting to note, however, 
traits which might be most objectionable in the classroom—disturbs clas 
ilkative whis} ering, writing notes—are all, with the cception of “talk 
ive,’ assigned more frequently to retarded than to superior children. In 
identally, it may not be amiss to call attention to the fact that it has bec 


mes that the two groups frequently are talkative 


very different reasons—the superior children because they know somethir 
in re so full of it that they must tell about it in spite of classroom rule 
the retarded because they are bored with what is going on in the classroom 
nd talk to relieve boredom. The most striking difference found relative 
this group of traits 1s that more than twice as many superior as retarde 
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ire characterized as “tidy.” It should also be noted that a great 

nore retarded than superior children are rated as class disturbers. 

These data, just presented, seem to indicate that mentally retarded 
in terms of traits assigned them by their teachers, are less well 
in personality reactions than are mentally superior children. The 

n traits are, therefore, in agreement with data derived from the 

’ P. C. Personal Inventory. 

further support of this conclusion is fou id when the ten traits 
preatest frequency to the superior group and to the re 
1p are compared. These data are given in Table VIII. Only one 


superior group among the ten most frequent has a rating 


four; six of the traits assigned 


to superior boys and five to 
TI yr girls are rated as five. In contrast, five traits assigned with the 
frequency to the retarded boys are undesirable from the point of 
mental health and only two receive a rating of five, while the 


irls are assigned four traits with two ratings, and four with ratings 





oe he two traits rated five by mental hygienists and which are among the 
ts most frequently assigned to retarded boys are “happy” and 
It is significant to note the frequency with which these traits, 


ilso among the ten most frequently assigned to superior boys, are 


detr 
to each group. “Honesty” is assigned as a distinctive characteristic 
per cent of the superior boys but to only 23.1 per cent of the 
. boys. Again, 44.6 per cent of the superior boys and 26.1 per cent 
tarded boys are characterized as “happy.” 
"6 A comparable situation to that just cited is found when the four traits 


‘ 


five, and assigned with the greatest frequency to both superior and 
rirls, are examined. The comparative frequency with which these 
re assigned to superior and retarded girls are: “happy,” 49.6 and 
cent; “friendly,” 48.0 and 17.9 per cent; “honesty,” 42.6 and 25.0 
dependable,” 62.4 and 20.6 per cent. It is evident, then, that 

traits which are rated as possessing definite hygienic value and which 
found among the ten traits most frequently ussigned to both superior 
tarded children are ascribed with much greater frequency to superior 


On 


The problem of sex differences in personality as measured in this 


vestigation has so many ramifications that only a few salient points will 
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presented. In terms of the P-score on the B. P. C. Personal Inventory, 
in both intelligence groups have higher median scores than do girls 

the differences are statistically reliable. 
Teachers display a consistent tendency to assign traits, which are de- 
e from the mental hygienists’ point of view, with much greater fre- 
icy to girls than to boys. They also assign traits which are undesirable 
the mental hygienists’ point of view with much greater frequency to 
than to girls. Two traits only, which are rated as having definite 
nic value, are assigned more frequently to boys than to girls, namely, 
venturesome” and “likes jokes.” One trait only, rated as being un- 
ocally harmful to mental health, is assigned more frequently to girls 

» boys. This trait is “over-sensitive about self.” 

The data from both the B. P. C. Inventory and the traits assigned by 
ers in general seem to indicate that boys as a group in this investigation 
e less well integrated personalities than do the girls. This conclusion is 
) agreement with those of Cornell (1), McGehee and Lewis (4), St. John 
(8), and others that the boys in the elementary school are more maladjusted 





in are the girls. 
It seems reasonable to interpret these findings as indicating that the 
mentary schools are not meeting the needs of the boys as well as they 
re meeting those of the girls. If we grant the accuracy of this interpreta- 
mn, we are faced with a situation which calls for correction. It means that 
rents and educators need to give consideration to the problem, need to 
eek out the causes of the relatively undesirable personality development on 
he part of the boys with the purpose in view of revising our home training 
nd educational program so that the boys at least will keep pace with the 
rls in personality development. 
The data presented in this study appear to justify the conclusion that 
the child of superior intelligence has a much better chance of developing a 
lesirable personality than the child who is retarded in intelligence, whereas 
the child who is retarded in intelligence has more chance of developing an 
ndesirable personality than does the child of superior intelligence. This is 
not to deny that children of superior intelligence may develop undesirable 
personality characteristics or that children of retarded intelligence may de- 
velop desirable personalities. The data present ample evidences of both 
types of development. The significant feature is that both types of data 
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point quite unequivocally to the fact that more desirable personalities 
found among those who are superior in intelligence, and more unde . 
rsonalities among those who are retarded in intelligence 
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ONVENIENT METHOD FOR CALCULATING INDICES 
OF EASE AND OF DIFFERENTIATING ABILITY 
FOR INDIVIDUAL TEST QUESTIONS 


L. N. GARLOUGH 
University of Omaha 


note: The relative ease and discriminating ability of individual 


has long been discussed. The author presents a new short method 
nashation 


relative ease and differentiating ability of individual test questions 
been discussed, and several methods for the analysis of these two 
rs are available. The technique here described results in indices 
ease and differentiating ability from the same set of computations 
tual work is of such simplicity that clerical assistants can perform 


tions. Ease and differentiating ability will be defined in the 
of the method 


. L, nal 
ine | ethod makes 


ise of two prox edures that are far from new. First, 


tained from any single question are compared to results ob- 
J < i 


some broad criterion, in this case, the entire test. Second, the 
iterion (total test results) is used as a basis for dividing the class 
ned classes into consecutive parts, in this case, fifths. In each of 
is, then, for objective test questions the proportion of correct an- 
ich single question is obtained. The calculation of proportions 


by first setting up a table of proportions. The actual 
} & Ul 


eT ee 
simpiuned 


y of correct answers is easier if correct rather than incorrect answers 

when papers are graded. For discussion questions that are scored, 

r column matching questions, the mean score in each fifth is obtained, 

expressed as a proportion (decimal) of the perfect score on that ques- 

Scoring discussion questions on the basis of 10 as a perfect score will 
plify matters. 


[he indices are obtained by a “‘least squares” fit of a straight line of 


m } t-+ bx. Such a line may be interpreted as the locus of most 
Osburn, W. J The Selection of Test Items,’ Review of Educational Resear 
February, 1933), 21-32 
Ruch, J. M. “Recent Developments in Statistical Procedures,” Revieu Edu 
Research, U1 (February, 1933), 33-40 
Hendricks, B. C., and Handorf, B. H. “New Examinations from O] Jour 


ical Education, XVI (July, 1939), 329-332. 


(Uses a median score and a scat- 
to indicate ease and differentiating ability.) 
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representative, or expected, values. (“Least squares” refers to the fact that 
the sum of the squared differences between fitted points and the line Points 
is least about such a line.) Figure 1 is a graphic presentation of the method 
The black circles represent the proportions of correct answers in each fifth 
of the class, on a single hypothetical question, the proportions being 4 
30, .60, .80, .70. Two places of decimals are sufficient. The heavy diagona 
line is the fitted line. In the equation of the line, y= a+ bx, a is the 
value of the point of intersection of the fitted line with the ordinate (vertical 
line) at x= 0; it is the average height of the line above the base. In the 
present problem, a is the expected, or most representative, proportion \ 
correct answers in the whole class. This is the index of ease. If no answers 
are correct, the fitted line will coincide with the base line of the chart, and 
intersect the mid-ordinate at the y-value zero—that is, ease is zero. If al 
answers are correct, the fitted line will coincide with the top line of the 
chart, and intersect the mid-ordinate at the y-value one—that is, perfect 
ease (all answers correct) is indicated by an index of one. Intermediat 
degrees of ease will be indicated by decimal fractions. This increasing 
the index from zero to one as more and more questions are answered 
rectly prompts the use of the term “index of ease”, rather than “index « 
difficulty”, the more usual term. 

As to differentiating ability of any single question, an ideal condition 
would be one in which is found no correct answers in the lowest fifth « 
the class, 25 per cent in the second lowest, 50 per cent in the middle fifth 
75 per cent in the second highest, and 100 per cent of correct answers it 
the top fifth of the class, In the case of scored questions, these ideal figure 
would be the mean percentage scores on the question in each fifth of the 
class (see Fig. 2, upper left). Under such conditions the fitted line wo 
coincide with the diagonal from the lower left to the upper right corn 
of the chart. In a square, the slope (y divided by x) of such a line is 
That is, ‘perfect’ differentiating ability is indicated by an index of on: 
and other degrees of differentiating ability will be represented by the s/o, 
of the fitted line. This slope is 6 in the equation for the line. If the san 
proportion of correct answers is found in all fifths of the class, the questior 
obviously shows no differentiating ability. In such a case the fitted line | 
horizontal, with zero slope, giving an index of zero. It is possible to obtai: 
a value of more than one for this index (Fig. 2, upper center). This occurs 
when little or no difference is shown between the upper two groups (fifths) 
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remely high proportions of correct answers, and at the same time 


no difference between the lower two groups with extremely low 
ns of correct answers. While this is not perfect differentiation as 


fifths are concerned, the question giving such an index might be con- 
»00d one from the practical standpoint, since it differentiates very 


tween the upper and lower parts of the class. Figure 2 shows several 
ssible patterns with their fitted lines—the symmetry of the data is of 


irtificial. The lower right figure illustrates an interesting type that 


nce in a while—about as poor a ¢ 


question as one could find. 


necessary, then, to calculate the values 4 and 4 of the equation 


bx, a being the index of ease (E) and & being the index of dif- 


ability (D). Now, the so-called “normal equations” for find- 


nd & in a least squares fitting of a straight line of the form 


> 2(a) + 3x(d) 
Sx(a) + Sx*(d). 


tA 


tes the sum of quantities following. In this case, y is the proportion 


answers Or mean percentage score in each fifth, » is the number 


s to be fitted (five), and x is the value assigned to each fifth of the 


Rather than numbering the five groups consecutively from one to 


the mid-group is called zero, the lower two minus one and two, the 


two plus one and two, as shown in Figure 1. The sum of x’s (i. e., 


) then becomes zero, and the two “normal equations” become 


=) Sa-+ 05, (since n 

ixy == 02 + 104, (the sum of the squares of x == 10) 
1S 

=) Sa 

=X} 104 


ng for a, the index of ease, (BE) 


E >) 
> a — 0.257. 
5 2) 


i 
' 
: 
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But the range of y is from 0.00 to 1.00, that is, 1. The range of x is from 
minus 2 to plus 2, that is, 4. The slope of a diagonal line from the lower 
left corner to the upper right corner, representing “‘perfect’’ differentiating 
ability would be 

ben on 

x 4 

For the index of “‘perfect’’ differentating ability to become 1, 4 must be 
multiplied by 4. So, the index of differentiating ability* is 
4(3%7) 


D—4b: 
10 


= 0.4 =x. 


Figure 3A is made up as a rubber stamp the imprint of which fits 
a 3 inch by 5 inch card. All necessary calculations are given (S is used in 
stead of & for convenience in manufacture). Figure 3B shows the calcula 
tions for the data of Figure 1. In the procedure used by the writer, que 
tions are typed upon 3 by 5 cards, at the top edge of which are placed the 
classification number of the question, the coded answer, E=.. . 
D=..... On the back is stamped the calculation table of Figure 3A 
A clerical assistant divides the class papers into consecutive fifths, calculate 
a table of proportions, counts correct answers or calculates mean percentage 
scores on each question, in each of the fifths, enters the appropriate prop 


*To arrive at differentiating ability, authors have used the correlation coefficient 
(and even merely the scattergram) between total score on test and score on individual 
question. This method is applicable only to scored questions—biserial ¢ would have 
to be used for objective questions marked right or wrong. But scattergrams are 
cumbersome, and correlation coefficients are a bit onerous to calculate and not easy to 
interpret. They show a relationship in the sample at hand, but a regression siope 
shows an expected relationship in the supply, a statistic of much broader meaning 


The easily calculated slope (D) here used is the regression slope, ren(). The 
Ss 


same value for D is obtained: 


_ (=: )= iy (-") — 2 
Ss N5x5y Sa Ns, 


Rank correlation is not applicable here. Since in this case s, always equals ‘:, 
the regression slope will always equal r. Since ranks instead of values are used, the 
same ¢ and the same slope will be obtained for any given sequence of ranks. F 
example, y= 0, .25, .50, .75, 1.00 will give the same slope as y = .48, .49, .50, .51, 
52, since in each case the y-ranks are the same for the consecutive x-values —2 to +2 
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he stamped calculation table on the back of the card, calculates Sy 
as indicated, calculates E and D as indicated, and enters these on 
e of the card at E==..... and D=..... As is seen, actual 
ons involve only the simplest of addition and multiplication. When 
, up tests, cards are selected on the basis of E and D and sent to the 
sraphing department. Coded answers render this safe. For objective 
when cards are returned a key is made upon a copy of the test by 
of the coded answers and the cards are refiled, by means of the 
tion number, under their appropriate subject matter categories. 
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ire 1.—Graphic presentation of the method. The heavy line is the least squares 
straight line fitted to the proportion of correct answers shown. 
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SUMMARY 


The technique described results in an index of ease and an index 


differentiating ability for individual test questions, by means of very simy 
calculations. ‘‘Perfect’’ ease and ‘‘perfect’’ differentiating ability a 


indicated by an index of one. Total lack of these two qualities is indicat 


by an index of zero for each. The two indices are derived from the pr 


Aner 
7 
‘ 


ties of a “least squares” fit of a straight line to proportions of correct 


swers to any objective question, or to mean percentage scores on discussior 
questions, in consecutive fifths of a class, the fifths being based upon ti 
broad criterion of achievement on the test as a whole. 
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Figure 2.—Six hypothetical distributions of proportions of correct answers, 
showing patterns for various values of E and D 
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THE TEMPORAL POSITION OF REVIEWS 


J. B. Stroup and ETHEL JOHNSON 
State University of lowa 


Editor's note: Logically it would seem that the first review exercises 
should appear soon after learning and at less frequent intervals as time 
goes on. The author suggest that failure of certain experimental results to 
conform to their logical expectancies may be due to the fact that th 
review value increases as the interval between learning and reviewing 
increases. 


INTRODUCTION 





As THE reader who has followed the literature pertaining to review 


well knows, it has seemed logical to many authorities that the first 
exercises should appear soon after learning and be comparatively fr 
with less frequent appearances being required as time goes on. This t 
ing has been deduced from the negatively accelerated character of the | 
binghaus curve of forgetting. In attempting to appraise it, it is fittis 
inquire what the object of review is. If it is to maintain at any cost 
functional level of attained knowledge, probably no one will questior 
soundness of the teaching. 

If the issue is that of the most economical method of securing 
benefits from learning through the expediency of review, the prol 
whether it is more economical in the long run to maintain a given 
tional level of knowledge or to regain it. Or, to put the question n 
directly, does a number of repetitions, employed as review, add more t 
permanency of knowledge when indulged in soon after learning, be! 
very much is forgotten, than at a more remote date, after much has | 
forgotten / 

It may serve to clarify the issue to note that there are, in effect, 
general kinds of review, or two general methods of reviewing: (1) 1 
or symbolical review, as in silent or oral rehearsal, written reproduct 


verbatim or in substance, and response to various forms of objective test 


(2) reimpression, as in rereading, where the original performance is 
peated, in whole or in part. There is no 4 prior? reason why the two ki 
of review should be affected alike by variations in experimental or cla 
room procedure. In fact, the published research, as recounted in brief 
sequently, shows that the varying of temporal positions affects these 


kinds of review differently. 
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Peterson, et al. (1935) sought to determine the effect of varying tem- 
positions of reviews. A six-page selection of prose material was 
| under similar conditions by each of three equated groups of subjects 
ce students). In one experiment Group 1 reviewed by rereading on 
ond or third day afterwards, Group 2 on the seventh day, while 

3 a control, did not review. In a second experiment, Group 1 re- 
ed on the first day following the original learning, Group 2 on the 
| day, while Group 3 again served as a control. Retention tests, essay- 
were administered to all groups twice: (1) on the tenth day following 
riginal learning, and (2) on the twenty-first day. They found the mean 

es of Groups 1 and 2, in both experiments, not to vary from each other 
iently to signify any superiority of one position over another, although 
mpared with the control, review at any position proved to be highly 

It has been suggested that any advantage that might accrue to any 

position is lost, through the normal processes of forgetting, in view 
the fact that a longer time elapses between the review and the final 
ng. This reasoning is somewhat invalidated by the experimental find- 

; of Peterson et al. to the effect that final retention tests administered 

enty-one days after learning (12 days after the most remote review) gave 
same relative results as those administered only ten days afterwards 

i day after the most remote review). 

Spitzer (1939) in an elaborate investigation involving about 3600 
th-grade pupils studied the effect of varying the temporal position of 

bjective tests employed for review purposes. This form of review may be 

garded as symbolical. The “review test,” a 25-item multiple-choice test, 

s administered to various groups 1, 7, 14, and 21 days after the original 

ining. The material learned was a specially-prepared prose selection con- 

sting of about 600 words. The final criterion test, an objective test, was 


fter the original learning exercise. Two significant outcomes especially 

hould be noted: first, the administration of a multiple-choice test performed 

important review function; and, second, the earlier the test was 
ministered the greater was its review value. 

In an investigation recently completed by Stroud and Sones (1940) 

the results of Peterson et al. are confined with respect to rereading review, 

and those of Spitzer, with respect to the use of an objective test for pur- 








. 
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poses of review. The foregoing investigations warrant the following tent 


tive conclusions: first, when rereading is used as the instrumentality of re 





view, the effectiveness of such reviews is independent of the temporal posi 


tion at which such review is inserted, within the time limits of the experi 


ments—1 to 17 days. Second, when objective tests are used as review m¢ 


the value of such reviews decreases as the time interval between learnine 


ind their introduction increases, within the time limits of the experin 


to 21 days. One may suggest that effectiveness of any kind of recall exer 


se will, for review purposes, be greater when introduced early rather 

te. Third, the comparative value of rereading and testing reviev 
function of their temporal positions. The study of Stroud and Sones n 
this comparison possible. When given on the first and third days follow 
learning, the testing review was found to be reliably superior to rerea 
reviews; when given on the fifteenth and seventeenth days afterward 


rereading review proved to be reliably superior to the testing review 


EXPERIMENTAL PROCEDURI 


The investigation reported subsequently was undertaken as a further 


check on the effect of varying the temporal position of rereading reviev 
} 


In the investigations conducted heretofore, the effect of the various review 


has been determined by administering a criterion test after a lapse of 
specified number of days dating from the original learning activity. T! 
procedure necessitates the lapse of longer intervals between the review 


f the 


Lic 


ind testing in the case of the earlier positions than in the case « 
positions. In the procedure followed in the present investigations tl 
riterion test is administered immediately after reviewing at each tempor 
position. Control groups which did not review but which in other resp 
re comparable to the review groups, also took the criterion test. Not on 
does this procedure serve as a check on earlier studies, but it is also design 


to give some evidence of the net review effect at the various temporal po 


I 
tior () ourse y re i] } P } ; > ; } } ‘ | rf oO ] 
tions f course, more will have been forgotten by the end of 20 d 
than by the end 


of 1 day. Will the net effect of a rereading on the 20th 
be greater than that on the 1st day? 

About 600 7th 
The 


served as subjects 


8th, and 9th grade pupils in three different scho 


material studied was a 1750-word article The Mak: 


Paper, and the criterion test was a 40-item, 4-response objective test. The 


subjects were divided into six random and presumably comparable groups 


y 











( 








TEMPORAL POSITION OF REVIEWS 621 


were allowed 25 minutes for reading and study on the first day. 
experimentally defined as the learning period. One day afterwards 

ook the criterion test and subsequently reread the learning ma 
[he latter activity was introduced merely to keep the members of 


© Latte 


pied during the remainder of the experimental period. At 


CALCU 


time Group 2, for which Group 1 served as a control, reread the 


iterial (12 minutes being allowed for this activity) and subse 

the criterion test. It is assumed that a comparison of the scores 

1 and 2 will reveal the net effect of the review exercise employed 
ip position 

criterion test was administered to Group 3 fifteen days after learn 

it this group’s previously having reviewed the material. The test 

ministered to Group 4 during the same class period but with the 

it the members had been allowed to review the material (for 12 

) before the test was administered. Likewise, Group 6 reviewed and 

took the criterion test on the 29th day after learning. Group 5 


erion test at this time without having reviewed prev iously 


RESULTS 


will observe that the odd-numbered groups did not review 
f taking the retention test. The even-numbered groups did re 
rial prior to taking the test. Thus, Group 2 and its control, 


; 


wok the retention test one day after learning. A comparison of 
; . } 
iffords evidence of the value of a review exercise placed 
after learning; of Groups 3 and 4, 15 days after learning; and of 


9 days after learning. The numerical values are shown in 


of the differences are statistically significant. The critical ratios are 
The wet return from the reviews increases as the time interval 

irning and review increases. For example, Group 6 ichieved a 

of 24.6 on the retention test administered subsequent to a review 

th day after learning; Group 5, the control, a hieved a mean score 

i at the same time. On the other hand, Group 2 achieved a mean 


f 24.9 on the test administered subsequent to a review on the first 


; laarni . " 1 > . ] . : 
er learning, while Group 1, the control, achieved a mean score of 


[hese results may be offered as a partial explanation of the fact that 


f 


ro 
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TABLE I 


THE VALUE OF REVIEW INTRODUCED AT THREE TEMPORAL POSITIONS 


Advantage 

Group Mean Difference S. E. Diff. of Review 

| in pe t 
a7 | | 
2 24 3.2 76 } { 
; | 19. 4 | 
4 24.2 4.8 71 2 

1 > 4 

4 24. 6 9.2 9 


N = (about) 100 per group 


previous research has failed to find any advantage in favor of one temp 
position of (rereading) review over another. It is suggested, therefore, that 
the effectiveness of a rereading review is not affected appreciably by the 
temporal position at which it is introduced because the met review val 
increases as the interval between learning and reviewing increases. 
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\ MEASURE OF THE VALIDITY OF ATTENTION SCORES! 


J. R. SHANNON 


Indiana State Teachers College 
Terre Haute, Indiana 


Editor's note: An instrument of considerable practical import for the 

lassroom teacher was proposed some years ago by Morrison and extensively 

ed by his students. The author presents data that question the validity of 
s instrument. 


SOME years ago there came from the University of Chicago a proposal 
iluating classroom instruction by means of attention scores. The device 
isted of an observer's noting during each minute of class procedure the 
ber of pupils who were attentive and the number who were inattentive. 
vious instances of attention or of inattention were assumed to be easily 
rnible, and for the more debatable cases certain “characteristic physical 
tudes” were suggested as evidences. That the device is reliable is no 
r questionable. Its reliability has been sufficiently established in experi- 
ts by Clarence E. Blume and by the present writer.* If its validity 
e equally well established, there are a number of worthy uses in ad- 
nistration and supervision which an alert student of education could make 
How about its validity? 
[he validity of attention scores as evidence of quality of classroom 
hing has, to say the least, been questioned. The present writer‘ has 
pressed his doubts thus: 


That certain external evidences of attention may be regarded as valid 
lications of attention, errs in the implication that mental states have 
tandardized objective physical concomitants. A child may be attentive to 
| that is said, but still sit languid with his eyes closed, or look out of the 
vindow. Also, he may follow every movement of the teacher with his eye 
it have his mind on her dress or physical appearance. 


* Acknowledgment for assistance in this study is gratefully extended to the fol- 
wing graduate students of Indiana State Teachers College: William W. Pyle, 
Opal K. Harris, Mildred Hixon, Wenonah M. Goshorn, John R. Cox, Eugene V. 
Skelley, Paul Pielemeier, and Eleanor M. Hamilton. 

* Morrison, Henry C. The Practice of Teaching in the Secondary School, Chicago: 

University of Chicago Press, 1926. Chapter VIII. 

* Blume, Clarence E. ‘Techniques in the Measurement of Pupil Attention,” The 
Second Yearbook of the Department of Supervisors and Directors of Instruction. New 

rk: Bureau of Publications, Teachers College, Columbia University, 1929, Chapter 

III; Shannon, J. R. “A Comparison of Three Means for Measuring Efficiency in 
Teaching,” Journal of Educational Research, XXIX (March, 1936), 501-508. 

“Shannon, J. R. Ibid. 
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A more impressive statement of similar doubts comes from F. | 


Henzlick 


Doctor Judd of the University of Chicago came to us a few years 
with the proposition that the single criterion of attention was sufficies 
letermine the worthwhileness of the recitation. He would have us belie, 
that if he had twenty pupils in a class and five were carelessly looking o 
of the window, apparently giving little attention, the recitation was 
seventy-five per cent a success. Such a recitation may be twenty-five per 
1 failure, but certainly we should hesitate to say that it is seventy-five 
ent a success. First, because the fact that children are apparently 
attention, at least having the external signs of it. is not conclusive evid 
that they have their minds on the content of the recitation emphasiz 
the teacher. They may be interested in her dress or in her most re 
marcel or in things a thousand miles away from the classroom. Nor 
ultogether certain that just because the pupil is looking out of the wind 
his mind is necessarily in the same place. I have often found in checki: 


Tel 


up students under such conditions that the external signs of inattention ‘ 
not state the whole truth. Students sometimes give evidence of knowir 
what the recitation is about in spite of apparent inattention. So long as w 


do not have psychological thermomoters or barometers to measure this thing 





" 


called attention, we cannot depend upon it as the only criterion for judgis 


1 good recitation 


Professor Henzlick mentions his having proof that attention scor 
lack validity, but he does not present his evidence. Perhaps his proof is 


empirical. The present report is of an experiment which produced statisti 


. 
evidence on the moot subject. The gross procedure of the experiment 
sisted of measuring attention during each bit of the oral reading of 


exposition and of testing the pupils immediately afterwards on each of tl 


2 
bits.” The details of procedure are shown by the following outline 

1. Preparing the exposition. 

a. A revised form of “Life Preserver of the Air,”’ by Paul W. Kearne 
(Safety Education, Nov., 1937), was used. This material was selecte 
partly because of its intensive informational content and partly because 
was presumed to contain information which was new to the pupils. 


' 


b. Care was observed in revising the article to make sure that the ide 


overed by the test appeared only once in the article 


* Henzlick, F. I Desirable Characteristics to Look for in Evaluating the Recita 
1.” Educational Method, X1 (January, 1932), 226—230 
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Parts of the original article which were not covered by test items 
deleted sufficiently to make various “bits” of the revised article 

ately equal in length. 
The revised article was mimeographed, and lines were drawn clear 
the mimeographed pages dividing the whole exposition into twenty 
ximately equal divisions. 

The teacher of the first group of pupils used in the experiment 
r cent i the revised article to another of her classes, and the exposition proved 
interesting enough but not too interesting for the purpose of the 
ment 
2. Preparing the test. 
€ 1. One test item was prepared for each of the twenty divisions of the 
10n 

Multiple-choice tests with five alternatives each were used. The test 
prepared according to the best theory of test construction. 
fter the exposition was read to the preliminary group (see ‘1 e 
), the test was given. This trial showed the test to be fair and clear, 


ing s items checked correctly by as many pupils as reasonably could be 





of , 1 
] } 


Pil pected, but by no more. 
3. Training the attention scorers. 
a. Three graduate students in education at Indiana State Teachers Col- 
served as attention scorers. They were trained in the art of attention 
ical oring before the experiment began until they were reasonably proficient 
their scoring reliable. 

The training consisted first of drill on Morrison's “characteristic 
+ ysical attitudes” which are supposed to be evidences of attention or of 


perimental observation in a college class while the revised 


Life Preserver of the Air” was being read proved that the scorers could 


c An @ 
ne ——— : : ' . ; . ; 
low the reading and score attention simultaneously. (Some of the college 
lents were purposely inattentive part of the time.) This trial also proved 
that the twenty divisions in the exposition required about one half minute 
reading time each and that such lengths were convenient for attention 
oring 
d. The three scorers practiced fifty minutes a day for two days in the 
lassroom with the first group of pupils used in the experiment before the 


ita 


experiment began. 
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4. Reading the exposition. 

a. The exposition was read in two seventh-grade and two eighth-grade 
classes in two schools of Terre Haute, Indiana, in the fall of 1939. The 
numbers in the four classes from whom usable data were obtained were 
twenty-nine, twenty-eight, twenty-five, and eighteen, thus making a total of 
one hundred junior-high-school pupils. Forty-seven of the hundred were 
boys and fifty-three were girls. 

b. A normal speed of oral reading was used by each teacher. The total 
reading time was ten minutes. 

c. The reading of the exposition in each case was by the regular 
teacher in each case except in that of the twenty-eight pupils, in which case 
it was done by a student-teacher who had been working with that group 
tor several weeks. 

5. Scoring attention. 

a. Each attention scorer followed the same mimeographed material 
which the teacher read. In each of the twenty divisions of the exposition 
he indicated the pupils who were inattentive during that division. 

b. The particular portion of each division on which the corresponding 
test item was based was underlined in the mimeographed copy. The atten 
tion scorers were especially watchful to measure attention just at the time 
the underlined portions were being read. 

c. The scorers sat in such positions in each room that at least two of 
them could see each pupil well. 

d. In case of doubt concerning a pupil's attention or inattention, he 
was regarded as attentive. 


6. Administering the test. 

a. In no case did the pupils know when they listened to the reading 
of the exposition that they were to be tested on it immediately after. 

b. The tests were given promptly after the reading so as to allow no 
factors of memory or learning from later discussion to enter. 

7. Supplementary data. 

a. Group intelligence tests had already been given by the officials of 
the two schools, but only seventy-seven of the hundred pupils used in th« 
experiment had been tested. The seventy-seven were equitably divided 
among the four classes and the two sexes. 

b. The pupils were slightly below average in intelligence. The highest 
I. Q. in the group was 126, the lowest was 61, and the median was 94 
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figures representing the extremes and the median for each class and 

sex were approximately the same as for the group as a whole. Since 

wo schools drew their pupils from less desirable parts of the city, they 
suspected of having pupils with a low average of ability. 

8. Treating the data. 

a. If all three attention scorers did not agree on a pupil's being atten- 

or inattentive during the reading of a section of the exposition, the 

sion of the two who agreed was accepted. 

All coefficients of correlation were by the Spearman “Footrule” 
jula. In case of two or more equal numbers of one series paired with 
jual ones in another, the equal numbers were given ranks corresponding 
) the unequal ones with which they were paired. Thus the coefficients 

re made as high as they could be fairly. 

c. Although a pupil was not regarded inattentive during the reading of 
section of the exposition if only one of the three attention scorers re- 
rded him as such, the opinion of the one scorer was counted in computing 

ttention scores. If all three attention scorers judged a pupil attentive during 
h of the twenty sections of the exposition, the maximum attention score 
f 60 (20 times 3) was assigned. Each time any judge recorded a pupil 
ttentive, one point was subtracted from 60. For example, if a pupil was 
iged inattentive by all three scorers during four sections, by two of the 
wee during another section, and by only one of the three during two other 
ections, the pupil's attention score was 44. 

d. The pupils of the four classes were kept separate in all statistical 
mputations, but with a few exceptions the differences between the four 
asses were inconsiderable. Therefore, no further attention to the four 
lasses is given in this report. 

e. The exposition (dealing with parachute jumping) evidently had a 
greater appeal to boys than to girls, and although the girls may not have 
manifested inattention, they made noticeably lower scores on the test cov- 
ering the exposition. Therefore, sex differences are observed throughout 
this report. 

FINDINGS 


No pupil made a perfect score on the test, and no pupil made zero. 
[he highest score was 19 and the lowest 2. The-médian was 11. (The 
median for the boys was 13, and the median for the girls was 8.) No item 
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of the test was answered correctly by more than 83 pupils, and no item 
less than 22. Neither the first, last, nor any other part of the test seem 


harder than the rest.® 

Most of the pupils were attentive during most of the reading. M 
had perfect attention scores. Others went low, however, the lowest 
but the median was 58 (59 for boys and 57 for girls). Inattention 
present throughout the reading. The number of pupils inattentive 


pi 
ie reading of any section of the exposition ranged from 3 to 13, but durin 


fifteen of the twenty sections the number ranged from 5 to 10. There 
) tendency for inattention to be bad at any part of the reading; inste 


' 
prol 


was spasmodic except for a few pupils who were inattentive for f 


‘ 
i 


intervals 
A gross measure of the validity of attention measurement is possi 
through correlations. Some correlations which have a bearing on the su 


shown by the coefficients in Table I. The figures in the first col 


the table are based on the full hundred pupils, and those in the remair 


ire 


whom there were intellig 


nes are based on the seventy-seven for 
test da i 
TABLE I 
COEFFICI OF CORRELATION BETWEEN ATTENTION SCORES, TEST SCORES, 
AND INTELLIGENCI 
Attention Scores Attention Scores Test S 
and Test Scores und I gence Intellig 
Rova 6 l 7 
Giris 34 i 
I 9 ¥ 
Investigators have been making correlations of intelligence and achiev 


ment for years. We are so used to such correlations that we know wh 
) expect The ones shown in Table I are no contribution. The fact tl 
ilthough they are low, they are not exceptional, may lend some encoura; 
ment to the assumption that the other correlations shown in the table 


ire approximately typical of what we might find if we had many more su 
by a considerably larger number than any other 
A} le significance of fact will be pointed out late 

I Hool N. 7 How Shall We Predict High School Achi 


ae (a ( ind KS 


*The first item was missed 


‘+ ; : 


] urs ai Educati nm al Re earcn, XXII (October, 1930), 184-196. 
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ations. The higher correlation between attention scores and test scores 
- boys than for the girls should not be suspected of being typical, how- 
It seems to be due to parachute jumping’s being more interesting to 


than to girls. 


Although the boys were apparently more attentive and made higher 
on the test than the girls, the rank order of the twenty items in the 
nswered correctly by the boys and that of the girls had a correlation 


More specific measures of the validity of attention measurement are 


ed in an analysis of the test scores. Nine boys and twenty-eight girls 


‘ 
Vui 


were inattentive during the reading of one to fourteen sections of the ex- 


te 


ition. In a majority of such cases among the boys, their correct responses 


n test items covering sections of the exposition to which they were credited 
with being inattentive were more numerous than their incorrect responses. 
Among the girls the opposite was true. With each sex the same general 


gh 


4 


vg 


TABLE II 


ndency in test results obtained in items covering parts not attended to as 
items covering parts attended to. It did not seem to make much difference 
test results whether the pupils were credited with being attentive or not. 
ler details of this are shown in Table II. 


UMBER OF Times Pupits Dm THE SAME, Dm BETTER, AND Dm WoRrRSE ON 
Test Witt ATTENTIVE THAN WHILE INATTENTIVE 
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t exceeding wrong while attentive and also while inattentive - | 


t exceeding wrong while attentive and wrong exceeding right | 
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ve BNSSNSSSSHSSOSOSOSSSBOSSHORS8 


equaling wrong while attentive and also while inattentive 
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When the total number of correct and incorrect responses to items of wh 
the test covering sections when the nine boys and twenty-eight girls were 
attentive are compared with their correct and incorrect responses to items 
covering sections when they were inattentive, further evidence is found that 
it seemed to make but little difference whether they were credited with being 
attentive or inattentive. This comparison is made in Table III, and it 
shows that the responses to items during attention were but little better 


than during inattention 


TABLE III 


PERCENTAGES WHICH CORRECT RESPONSES WERE OF INCORRECT ONES FOR 
ATTENTION AND FOR INATTENTION 


| Boys Girls | Total 
’ | 
While attentive 143 | 68 82 
While inattentive 129 61 4 





Further evidence pointing toward the same conclusion is found in the 
cases of eight girls who made three or more correct responses each to items 
testing subject-matter to which they were supposed to have been inattentive 
The median test scores of the eight was 8, the same as for all fifty-three 
girls. The median attention score of the eight was 34 and the median I. Q 
88, both lower than the medians for all fifty-three girls. 

Still further evidence is that the correlation of the rank order of the 
twenty test items answered correctly by pupils who were attentive to the 
reading with that of the pupils who were not credited with being attentive 
was .70. 

The evidence presented thus far, although damaging to the validity 
of attention measurement in general, probably is applicable more to the 
invalidity of evidences of inattention. That the evidences of attention prob 
ably also are invalid is suggested by the following considerations growing 


out of the experiment. 

1. The numerous low test scores on items to which the pupils were 
credited with being attentive suggest that maybe the pupils were not as 
attentive as they looked. 

2. The first item on the test was missed by many more attentive pupils 
than any other. Since the teacher in each class had just started reading 
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. the first test item was covered, it may be that the pupils were not yet 

entrating in their listening although they appeared attentive. 

3. The very fact that the girls did much more poorly than the boys— 
;o than their lesser degree of attention could warrant—suggests that 

rirls gave external signs of attention when in reality their minds were 


rinhy 


CONCLUSION 


Assuming that the material read in the exposition was new to the 
n, the evidence is damaging to the validity of attention measurement. 
it has a slight degree of validity is clear, but that it has enough 


ty to warrant its use in judging classroom activity is worse than doubt- 
One might say that this conclusion should have been obvious without 
experiment, but evidently Morrison did not think so. 
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SHALL WE CHANGE THE CURRICULUM IN WARTIME? 


THE curriculum includes all the experiences provided or utilized by the 
school for attaining its goals. The children and young people in the public 
schools are daily meeting many experiences arising from the war. The ques 
tion we are considering may, therefore, be restated in this form: shall the 
school utilize the experiences of war and even seek to provide other experi 
ences related to the war? If these war experiences make no contribution 
to the present goals of the school, the question becomes even more searching 
Shall the goals of the school be redefined to take account of the war— it: 
successful prosecution and its consequences? 

Do the goals of the school now take account of the fact that the issue 
in this war is freedom versus slavery? Do we in the schools realize that uy 
to this point in the struggle the side for slavery is winning the war? Do 
we further realize that the forces of freedom could win the war and ther 
foolishly lose the peace? 

On December 30, 1940, the Educational Policies Commission unan 
mously approved its report on The Education of Free Men in America 
Democracy. As the Commission then said, “The events of every passing da 
have underlined the critical and urgent importance of the contributi 
which education alone can make to the defense and achievement of humar 
freedom." The question we face is whether the American public school is 
committed above all else to a program carefully ‘designed to give to the 
rising generation the loyalties, the knowledge, the discipline of free men 

In those schools which have redefined their goals to give first attentior 
to the essentials of democratic living and faith, the experiences natural 
arising from the war will be utilized effectively and supplemented wise! 
by other experiences provided by the school. The changes needed in such 
schools follow inevitably from the dominant goal of building for freedom 

Unfortunately, many schools have relegated the education of free me: 
to the accidental experiences of unguided student activities and to the high 
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zed experiences of a traditional college preparatory curriculum. In 


schools the goals of the curriculum must be changed. No substitute 


provided for properly directed education. Tanks, planes, ships are 
ied in the prosecution of the war. Intelligent, loyal, disciplined free 
o and will win the war and then organize the peace. The future is 
f we in education measure up to the needs of this new day. 


ARTHUR K. LOOMIS 
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Address all communications relative to book reviews to Editor Kai Jensen, 
University of Wisconsin, Madison, Wisconsin. 
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GREENE, HARRY A.; JORGENSEN, ALBERT 
N.; GERBERICH, J. RAYMOND. Meas- 
urement and Evaluation in the Elemen- 
tary School. New York: Longmans, 
Green and Co., 1942. Pp. xxiii + 639. 
$3.75. 

Since the beginning of the scientific 
movement in education, many textbooks 
have been published for use in courses in 
educational measurement in teacher train- 
ing institutions. Several conditions are 
responsible for the large number of text- 
books that have been published in this 
field during the few decades that teacher 
training institutions have been giving in- 
struction in educational measurement. One 
of these conditions is the disagreement 
among institutions concerning the content 
that should be covered in these courses 
Some believe the major emphasis should 
be on the use of published tests and the 
treatment and interpretation of results 
Others prefer to devote the largest share 
of the time to instruction in the con 
struction and use of classroom tests made 
by the teacher. 

Another condition is the fact that the 
personnel of classes in educational meas- 
urement varies considerably from one col- 
lege or university to another. In some 
cases, the instruction is given to graduate 
students only, in others to undergraduates 
Some institutions train elementary school 


teachers only and want a textbook deal- 
ing with the special problems of meas 


urement at the elementary school level 
Others prepare teachers for secondary 
schools and believe they should have a 
textbook written especially for higt 
school teachers. Many other institutions 
train both elementary and _ secondary 
school teachers as well as teachers of suct 
special subjects as art, music, industrial 
arts, and physical education. Instructors 
in these colleges and universities desire ; 
basic text that will meet the needs of 
teachers at all levels and in all field 
These varying needs have resulted in th 
preparation and publication of a large 
number of textbooks in educational 
measurement. 

Still another condition resulting in 
continued increase in the number of col 
lege textbooks in this field is the need for 
their frequent revision and expansion t 
include discussion of new techniques 
evidence, and practices. 

The book herein reviewed is a revision 
and expansion of a volume published in 
1935 under the title The Use and Inter 
pretation of Elementary School Tests. Dr 
Harry A. Greene and Dr. Albert N 
Jorgensen, authors of the earlier volume 
were assisted by Dr. J. Raymond Ger 
berich in the preparation of the revised 
edition released early in 1942. The new 
volume has 639 pages of material orgar 
ized into 25 chapters, whereas the earlier 
edition had 530 pages including 
chapters. 
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A casual examination of the table of 
ntents gives the impression that except 
the assignment of certain topics to 
ferent chapters, a change in the order 
of a few topics, and the addition of a 
few entirely new chapters, the new book 
not differ greatly from the previous 
n. However, a more thorough study 
the book reveals the fact that some 
fundamental changes and additions 
been made. The new topics treated 
personality testing, physical and 
education testing, rapid scoring de- 
und certain guidance and adjust- 
techniques. The area of practical 
rapidly becoming an important part 
he elementary school curriculum, is 
ted 
The authors have employed an organi- 
which combines the school-subject 
approach with a semi-functional ap 
Although such school subjects as 
ling, handwriting, and language have 
mbined into one subject field ap 
ely called the “expressive lan- 
arts," thus reducing somewhat th« 
of separate school subjects treated, 
vised edition devotes seven large 
s to problems of measurement in 
fic subject fields of the elementary 
curriculum. This makes necessary 
frequent repetition of certain basic 


principles of measurement 


In several respects this new volume is 
distinct improvement over the former 
yn. The order of presentation of the 
»ics treated should result in its being 
effective than its predecessor as a 
hing manual. For the most part, the 
thors have presented concepts in the 
rder in which they are needed by the 
lent to comprehend succeeding con- 
pts. The highly technical material deal- 


ng with the statistical treatment of test 


results has been placed near the end of 
the book. The increased emphasis on the 
importance of the informal objective test 
and the improved treatment of its con- 
struction and use constitute another note- 
worthy improvement. The authors also 
make a better distinction between stand- 
ardized and informal objective tests in 
this volume than they did in the earlier 
edition. While retaining some of the 
illustrations from older tests, this revised 
edition includes illustrative material from 
many of the recently published tests. Fin- 
ally, the improved table of contents will 
make for greater convenience in using the 
book for reference purposes. 

While this revised edition constitutes 
an obvious and decided improvement 
over the earlier volume, it is the opinion 
of this reviewer that it still possesses cer- 
tain definite limitations. For an introduc- 
tory course in educational measurement 
for students not all of whom are prepar- 
ing to teach at the elementary school 
level, this revised edition (as well as its 
predecessor) will not meet fully the 
needs of all of the students. In such 
classes, 2 book which presents and devel 
ops the principles of measurement com 
mon to all levels and all subject fields 
would be more satisfactory. The authors 
of this book do devote several chapters 
to problems of measurement that are com 
mon to all levels and areas. In some in 
stances, they even draw their illustrations 
from subjects that are taught at the high 
school level only 

Because the typical classroom teacher 
has more frequent need for informal tests 
than for standardized tests, problems 
related to the former probably should be 
given even more extensive treatment than 
they were by these authors. If teachers 


are to produce good tests, they need to 
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have each principle, rule, or suggestion 
illustrated liberally with actual examples 
of good and poor practice. Experience has 
shown this reviewer that the mere cita- 
tion of a rule is seldom effective in teach- 
ing the student to formulate test items 
that are free from structural weaknesses. 
It is necessary to illustrate such weak- 
nesses, explain them carefully, and dem- 
onstrate how to remove them. The auth- 
ors of this text apparently either believe 
that this procedure is not necessary, or 
they are not convinced that the ability of 
the classroom teacher to construct effec- 
tive informal objective tests is of sufficient 
importance to warrant devoting the space 
necessary for that type of treatment. 

The effectiveness of any such book as a 
teaching instrument is partially depend- 
ent upon the care employed in selecting 
the examples used for purposes of illus- 
tration. If the authors of this textbook 
had used examples of only the best prac- 
tice in illustrating different types of ob- 
jective test items, the book probably 


would exert a better influence upon prac 
tice in test construction. One of the sets 
of matching exercises illustrated, for ex 
ample, has the same number of items ip 
both lists. Also, the examples of multiple 
choice items leave the impression that 
only the incomplete-statement type of in 
plied question should be used, whereas 
experience has taught this reviewer that 
the direct-question form enables one 
avoid many of the structural weaknesses 
frequently found in objective test items 

For those desiring an up-to-date and 
rather thorough treatment of the prob 
lems of measurement in the elementary 
school only, this revised edition should 
fulfill a real need. Those who used the 
former edition as the basic textbook in 
their courses in educational measurement 
will not need to make serious revisions 
of their syllabi when they change « 
to this new edition of a widely-used text 
book. 

_ GERALD V. LANNHOLM 

University of Cincinnati 
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Research Abstracts and Bibliographies 


Address all communications relative to research abstracts and bibliog- 
raphies to A. S. Barr, University of Wisconsin, Madison, Wisconsin. 




















BULLETINS 


AMERICAN EDUCATIONAL RESEARCH AS- 
CIATION. “Fine and Applied Arts, 
mercial Education, and Home and 
Family Living,” Review of Educational 
Research, XI. Washington, D. C.: 
American Educational Research Asso- 
ciation, National Education Association 
of the United States, 1941. Pp. 363- 
417. 
This issue reviews the literature for a 
three year period ending March, 1941, on 
ymmercial education (including business 
training), art, home and family life edu- 
ation, industrial education (including 
national defense), and music (including 


AMERICAN EDUCATIONAL RESEARCH AS- 
SOCIATION. “The Social Studies,” Re- 
view of Educational Research, XI. 
Washington, D. C.: American Educa- 
tional Research Association, National 
Education Association of the United 
States, 1941. Pp. 419-74. 


Reviews the literature on the nature 
and function of the social studies in edu- 
ation, the curriculum in the social stud- 
ies, methods of learning and teaching, 
chool and community life in the social 
studies program, and evaluation and ap- 
praisal in the social studies. 
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CARLEY, VERNA A. Inter-American 
Friendship Through the Schools. Bul- 
letin, U. S. Office of Education, No. 
10. Washington, D. C.: Government 
Printing Office, 1941. Pp. vi + 61. 


A study designed to answer the ques- 
tion, “To what extent does Pan—Ameri- 
canism mean something around the vari- 
ous schools in the United States?” 


COMMISSION FOR SPECIAL EDUCATION. 
The Education of Physically Handicap- 
ped Children. Bulletin of the Califor- 
nia State Department of Education, No. 
12. Sacramento, California: State De- 
partment of Education, 1941. Pp. viii 
+ 121. 


A bulletin intended as a guide to school 
administrators, teachers, school nurses 
and physicians, and agencies concerned 
with the welfare of physically handicap- 
ped children. 


EDUCATIONAL RECORDS BUREAU STAFF. 
1941 Fall Testing Program in Inde- 
pendent Schools and Supplementary 
Studies. Educational Records Bulletin, 
No. 35. New York: Educational Rec- 
ords Bureau, 1942. Pp. xiv + 57. 


A summary and interpretation of test 
results to assist member schools in con- 
structive educational guidance, with sup- 
plementary studies on the Cooperative 














638 JOURNAL OF EDUCATIONAL RESEARCH {Vol. 35, No. s 


Test of Social Studies Abilities, the 
American Council Psychological Examin- 
ation, and the revised Stanford Achieve- 


ment Test 


EVALUATION OF SCHOOL BROADCASTS 
STAFF. National Morale and Radio 
Bulletin No. 18. Columbus, Ohio 
Evaluation of School Broadcasts, Ohio 
State University, 1941. Pp. 8 


An analysis of morale in a democracy 
of interest to governmental and civic 
authorities as well as educational leaders 
in planning an effective use of radio in 


wartime 


FRAZIER, BENJAMIN W. Education of 
Teachers Selected Bibliography. U. S. 
Office of Education Bulletin, No. 2. 
Washington, D. C.: Government Print- 
ing Office, 1941. Pp. vi + 60. 


The third extensive bibliography on 
teacher education published by the U. S. 
Office of Education, containing selections 
from approximately three thousand refer- 
ences published between October 1, 1935, 


and January 1, 1941 


FRUTCHEY, Frep P. and LELAND, HAR 
LEY A. Educational Growth in the 4-H 
Dairy Projgect, Massachusetts, 1939-40 
Evaluation Studies in 4-H Club Work, 
No. 3; Extension Service Circular 369 
Washington, D. C.: U. S. Department 
of Agriculture, 1941. Pp. 16 + 10 


A mimeographed bulletin describing a 
study to compare the degree to which 
three 4-H educational objectives were 
attained by boys and girls who partici- 
pated in 4-H dairy projects and those who 
did not 


HeEisez, BRYAN. Effects of Instruction in 
Cooperation on the Attitudes and Con. 
duct of Children. University of Mich 
igan Monographs in Education, No. 2 
Ann Arbor, Michigan: University of 
Michigan Press, 1942. Pp. ix + 98 


An experimental study to evaluate a 
process of group thinking considered ad 
vantageous to a democratic society. The 
investigator reports favorable results 
providing time is not a primary factor 


HILDRETH, GERTRUDE. A Child Mind is 
Evolution: A Study of Developmental 
Sequences in Drawing. Morningside 
Heights, New York: King’s Crowr 
Press, 1941. Pp. 163 + Appendix 


A monograph describing one child 
evolution in mental development as r 
vealed in his drawings from  nursé 
years through adolescence. Illustrated 


Hoty, T. C. and WENGER, Roy. The 
Disposition of School Bond Issues and 
Special Levies Submitted in Ol 


School Districts Between January 


and November 4, 1941, Inclusit 

Mimeographed bulletin, Bureau of Ed 

ucational Research. Columbus, Ohi 

Bureau of Educational Research, O! 

State, University, 1941. Pp. 22 

A detailed mimeographed report 
table form of disposition of school bon 
issues and special levies submitted 1 
Ohio city, exempted village, and county 


school districts 


JACKSON, Ropert W. B. and FERGUSON 
Georce A. Studies on the Reliability 


of Tests. Bulletin of the Department 
of Educational Research, No. 12. Tor 
onto 5, Canada: Department of Educa 
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ial Research, University of Toronto, 

i1. Pp. 132 

e authors offer data to support the 

ntion that there is no such thing as 

reliability of a test, but only the re- 
of a test in a specific situation. 


N, WALTON C. Higher Education, 

1940. Biennial Survey of Educa- 
tion in the United States, 1938-40, 
hapter 3. Washington, D. C.: Gov- 
rnment Printing Office, 1941. Pp. iv 


4? 


‘his bulletin contains statistics of 
education, the growth of junior 
| four year colleges, standards in pro- 
onal schools, extension and graduate 
ruction, and the problem of ac- 
liting 
MURCHISON, CARL, Editor. Child Bebav- 
r, Animal Behavior, and Comparative 
Psychology. Genetic Psychology Mono- 
graphs, XXIV. Provincetown, Massa- 
chusetts: The Journal Press, 1941. Pp. 
551 
[his monograph contains articles on 
Fels Child Behavior Scales (for nur- 
ry school age children); measurement 
f the size of general English vocabulary 
through the elementary grades and high 
hool, and stereotypes in the field of 
ical eminence. 


NATIONAL EDUCATION ASSOCIATION OF 
THE UNITED STATES. Reading Insiruc- 
ton in Secondary Schools. Research 
Bulletin, No. 1. Washington, D. C.: 
Research Division of the National Ed- 
ication Association, 1942. Pp. 48. 

An overview of reading programs in 
secondary schools with special classroom 
procedure and devices that should prove 
helpful to administrators, teachers, and 


curriculum study groups 


New YorK STATE TEACHERS ASSOCIA- 


TION. Population Trends Affecting 
Public Schools, 1930-1940. Economic 
Trends Affecting Public Schools and 
Teachers. Metropolitan Areas and Fu- 
ture School Problems. Public Education 
Research Bulletin, Nos. 1, 2, 3. Al- 
bany, New York: New York State 
Teachers Association, 1941. Pp. 4 
each. 


Brief bulletins with appropriate graphs 
on recent social and economic trends and 
their effects on the public schools and 
teachers. 


REID, SEERLEY. Frontiers of Democracy: 
A Study of Radio Broadcasts Dealing 
with Technological and Social Prog- 
ress. Bulletin No. 48. Columbus, Ohio: 
Evaluation of School Broadcasts, Ohio 
State University, 1942. Pp. 52. 


The report of a study undertaken dur- 
ing 1939-40 to evaluate the broadcasts 
used to spread among school children the 
conclusions and recommendations of an 
impressive governmental committee 


RemD, SEERLEY. Radio and the Teaching 
English: A Study of the 10A Eng 

lish Curriculum in Rochester, Neu 
York. Bulletin No. 22. Columbus, 
Ohio: Evaluation of School Broadcasts, 
Ohio State University, 1941. Pp. 1 


+ 56 


This bulletin reports an evaluation of 
some important aspects of 10A English 
course in Rochester, New York, centered 
around the radio. The investigator con- 
cludes that considerable time can be spent 
in exploring new materials and activities 
without sacrificing the important tradi- 
tional skills 
































Research News and Communications | 


Address all research news and communications to Carter V. Good, 
Teachers College, University of Cincinnati, Cincinnati, Ohio. 

















Educational Policies Commission. — In 
January, 1941, at the suggestion of the 
National Committee on Education and 
Defense, the commission invited to Wash- 
ington the representatives of eight city 
school systems who worked with the staff 
in drafting teaching materials for use 
in studying the national defense program. 
As a result of two weeks’ work by this 
group, the following six pamphlets were 
prepared: Our Democracy; How May 
We Defend Democracy? Suggestions for 
Teaching American History in the Pres- 
ent Emergency; The School: An Arsenal 
for Democracy; How You Can Strengthen 
Democracy; and Current Documents on 
Democracy. These reports have been 
widely used in various school systems. 

In May, 1941, the commission pub- 
lished The Education of Free Men in 
American Democracy. This was the last 
and, in a sense, the culminating or 
summary volume in the series published 
by the commission to date. It enumerates 
the knowledge, loyalties, and discipline 
that are necessary for preparation for the 
life of freedom in American democracy 
today, placing these requirements against 
the setting of a world in the grip of 
struggle and destruction 

The report on The Education of Free 
Men in American Democracy has been 
extensively circulated among laymen and 
educators, with aid from the General 
Education Board. Study outlines for dis- 














cussion groups based on the report have 
been prepared both by the commission 
and by the General Federation of W 
en's Clubs. Summaries of the report have 
been sent to each local post of the Vet 
erans of Foreign Wars by the head 
quarters of that organization, and wide. 
spread comments and publicity in the 
press and over the radio, in connection 
with the report, have been forthcoming 

In October, 1941, the commission pub 
lished its report on The Civilian Con- 
servation Corps, the National Yout/ 
Administration, and the Public School 
This document deals with the following 
issue: 


“When educational needs arise which 
affect the national welfare, cut across 
the bounds of states, and appear to 
be beyond the unaided powers of 
states to meet, should the federal gov 
ernment operate and control educa 
tional programs intended to meet these 
needs? Or should the federal govern 
ment undertake to meet these needs 
by working through the state-and-local 
educational systems, strengthening these 
established agencies, supplying leader 
ship and financial aid, but not exercis 
ing control over the processes otf 


education ?”’ 


The commission in its report strongly 
favors the second alternative. It is pro- 
posed that as soon as they have completed 
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present emergency assignments of 
ng workers for the national defense 
ction program, the N.Y.A. and the 
C.C. should be discontinued as separate 
The functions of these organi- 
as would not be discontinued. Their 
itional functions would be trans- 
ed to state and local educational agen- 
their functions as a public works 
y to the general agency of public 
ks; and the student aid program 
the Office of Education and the local 
ol systems. The report has been 
ngly approved by the educational pro- 
ion and by the public. 
In November, 1941, the commission is- 
sued its publication on Education and 
Morale of a Free People. The report 
roposes that national morale is essential 
n time of war and crisis. It indicates 


that the principal ingredients of national 


rale are health, economic security, psy- 
logical security, confidence in one’s 
sociates and leaders, and loyalty to a 
mon purpose. The report suggests 


fourteen methods whereby the schools 


contribute to these ingredients and 
reby sustain and strengthen the na- 
1al morale for the job that has to be 


= 


lso in November, 1941, the commis- 
issued, in cooperation with the Ore- 
State System of Higher Education, 
udaptation of the report on The Edu- 
of Free Men in American Democ- 


racy for high school pupils entitled, 
Calling the Youth of the Nation. This 


lume will be widely used in Oregon 

id elsewhere for study of democracy by 

th school seniors. 

During 1941 the Educational Policies 
mission held thirty regional confer- 

nces, strategically located to serve various 


parts of the United States, on “Educating 


Youth for Civic Responsibility.” These 
conferences were based on an earlier re- 
port of the Educational Policies Com- 
mission entitled Learning the Ways of 
Democracy: A Case Book in Citizenship 
Education. A total of approximately 6,000 
persons were reached by these conferences 
plus several thousand more at evening 
mass meetings that were held in connec- 
tion with many of the conferences. The 
proceedings of each conference were pub- 
lished separately and have been distrib- 
uted to those who attended and to others 
interested in furthering the citizenship 
education program in the public schools. 


As the year drew to a close, the com- 
plete participation of the United States 
in the second World War became a fact. 
The Educational Policies Commission at 
once laid plans for making its resources 
available to schools and government agen- 
cies for the development of sound policies 
that will make the schools most useful 
in the national war effort, defend the 
essentials of education against unwise 
policies, and lay the foundations for a 
far-sighted educational reconstruction af- 
ter the war period. In February, 1942, 
the report, A War Policy for American 
Schools, was issued by the commission. 


This statement was prepared by Wil 
liam G. Carr, secretary of the commission. 


Research Division, N.E.A.—During the 
year, 1941, the N.E.A. Research Division 
has attempted to meet the demand for 
information both with regard to con- 
tinuing educational problems and with 
regard to the transitory or emergency is- 
sues. As with other agencies, the Divi- 
sion has been aware of many needs that 
could not be met within the limitations 
of the personnel, budget, and available 
time. 
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Letters of Inquiry.—Two or three years 
information section of the Divi- 
sion was answering about 400 letters per 


During 1941 the number of let- 


ago the 


month 
ters received monthly exceeded the 800 
mark. Most of these letters deal with the 
daily school interests of classroom teach- 
ers and administrators. In recent months 
the rising cost of living has increased 
facts about salaries and 

Many letters also deal 


other wel- 


the demand for 
alary scheduling 


with tenure, retirement, and 


fare problems 
by reference to N.E.A. publications, to 
professional books and magazines, and by 


bibliographies. Some 


Most letters are answered 


supplying general 
letters are referred to governmental offices 
and to other appropriate agencies. The 
great source of data that is still largely 
closed to the Division is the theses and 
research activities of the teachers colleges 
and schools of education. Attempts to 
meet this need have to date been unsat- 
tory and incomplete. 

Salaries. — During 1941 the Division 
has spent a large part of its energies 
in supplying details from its 1940-41 
biennial salary survey. This has been 
done chiefly through its March Research 
Bulletin, the Special Salary Tabulations, 
and the circulars prepared cooperatively 
with the Educational Research Service. 
A number of school districts have been 
provided special tabulations and 
other data to critical situations. 
Through a series of mimeographed re- 
leases, attention has been called to the 
rising cost of living and to steps that 
have been taken to adjust teachers’ sal- 
uries. The demand for these special serv- 


sf ac 


with 
meet 


ices has taxed the resources assigned to 


this general area 
Retirement.— The January, 1941, Re- 
earch Bulletin is a summary of the status 
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of state teacher retirement systems. This 
publication is the outstanding handbook 
in its field. The Division also has pre 
pared an up-to-date analysis of state re 
tirement laws, which it expects to issue 
1942 
National Council on Teacher Retirement 


early in In cooperation with 
the Division has helped state leaders to 
prepare new retirement legislation and t 
improve existing laws. Throughout 
Division continued to observe 
federal held of 
security legislation and to report to stat 


leaders all significant developments. TI 


year the 
activities in the 


question of extending federal social 
curity legislation to include public en 
significance for 
teacher The Na 
tional Education Association is concerned 
that any broadening of federal laws should 
give proper attention to the effect of such 
new legislation upon existing teacher re 
tirement systems. The data compiled by 
the Research Division provide a basis fo: 
the presentation of the profession's stake 
in the whole question of adequate pen 
sions and retirement provisions. 


Federal Legislation.—In addition to 
the federal Social Security Act, the Di 
vision has been interested in the income 
tax law and the Hatch Act. In both fields 
mimeographed releases have been pre 
pared and sent to local and state educa 
tional leaders. About every six weeks 
there is released a mimeographed state 
ment, entitled "‘Federal Legislative 
Events,” covering not only the areas 
mentioned but other federal proposals 
that may affect the schools. All of thes 
materials have been prepared to help loca! 
and state associations become informed, 


ployees has great 


retirement movement. 


so that appropriate policies and programs 
of action could be formulated 
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Ss. This ol Finance. — For a number of 
indbook the Research Division has been re- 
as pr ting upon various aspects of school 
tate re One of its most comprehensive 
¢ was the May, 1941, Research 
School Costs and State Ex- 
ement tures, 1930-39."" This study did not 
t le local expenditures, which during 
and t lepression years dropped to a low 
Partly to meet this decline in local 
state expenditures tended to 
ise. Yet in spite of increases in the 
© stat int of state expenditures, in a ma- 
5 Th rity of the states school costs did not 
ial 1s rapidly as expenditures for 
, ind relief. In brief, the depres- 
the ght forth new public services 
> Na their demands for a share of the 
cert lar 
should To offset the activities of certain tax- 
t such ghting groups and to reveal certain 
er re trends, the Division has issued a number 
ed by f mimeographed releases on legislative 
is for trends and proposals. Some of these were 
Stake prepared in cooperation with the N.E.A. 
pen Committee on Tax Education and School 
Finance. One such release, now in proc- 
in to s, deals with the probable financial dif- 
» Di ficulties arising from the current war 
come mergency. 
elds Among the Division's basic studies are 
pre the brief summaries issued under the title 
duca f School Finance Systems. These are two- 
yeeks page analyses for each state of the sources 
state nd distribution of state school revenues. 
tive All of these are prepared with the help 
areas f experts in the various states. Half of 
osals the forty-eight compilations have been re- 
hese vised up to the end of 1941; the re- 
loc: mainder are expected by the summer of 
ned 1942. In no other place do these basic 
rams facts exist in this concise and up-to-date 
form 
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Yearbooks. —In February, 1941, the 
Division brought to completion the year- 
book on Education for Family Life, a 
publication of the American Association 
of School Administrators. The 1942 year- 
book (now complete) of the same or- 
ganization deals with Health in Schools. 
Both are pertinent topics at any time, but 
particularly so in a period when the 
health and morale cf the general popula- 
tion will be an important factor in 
victory. 

For the Department of Elementary 
School Principals the Division edited the 
1941 volume, Language Arts in the Ele- 
mentary School. Perhaps no area of ele- 
mentary-school instruction is more in need 
of clarification than that of language arts. 
This very practical volume has been well 
received. Work has advanced steadily dur- 
ing the year on the next yearbook, In- 
service Growth of the School Personnel, 
which will be available in the summer 
of 1942. 

General Methods and Content.—In ad- 
dition to its work on methods and con- 
tent, as issued through the yearbooks, the 
Division has published a Research Bulle- 
tin, “Schools and the 1940 Census.” This 
bulletin is not only an attempt to inform 
educators with respect to population 
trends, but it is an effort to supply cur- 
rent material for high-school classes in 
the social studies. 

Early in 1941, with the aid of funds 
supplied by the Highway Education 
Board, the Research Division issued sev- 
eral safety leaflets for secondary-school 
teachers. These were informal discussions 
of how safety instruction might be intro- 
duced into such areas of study as art, 
civics, home economics, and _ general 
science. A supplementary list of films on 
safety has been prepared during the 
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year and will be issued early in 1942. 
Although many problems may be shelved 
by the war, safety is not one of them 
If it is wise now to conserve food, natural 
resources, and automobile tires, how 
much more important in our daily lives 
it has become to reduce the number of 
deaths and injuries from unnecessary 
accidents. 


In the field of inter-American instruc- 
tion the Division has distributed more 
than 25,000 copies of its bibliography, 
Latin American Backgrounds. Cooperat- 
ing with the N. E. A. Committee on In- 
ternational Relations, the Division pro- 
duces the newsletter, Among Us. This is 
proving to be an invaluable aid to class- 
room teachers and to administrators in 
establishing contacts with the culture of 
our American neighbors. Nearly 50,000 
copies of this newsletter will be dis- 
tributed five times during the school year, 


1941-42 (October, December, February, 
April, and June) to school systems, col- 
leges, and libraries. 


During 1942 the Research Division ex- 
pects to turn any necessary portion of its 
energies to the problems of the present 
emergency. There will be frequent de- 
mands for nationwide polls of trends 
with respect to high-school enrolment, 
school finance, taxes, salaries, and other 
indicators of school conditions. Emer- 
gency problems will require study. The 
Division will continue to advance along 


{Vol. 35, No. 2 


the lines that have characterized its prog- 
ress in the past. Salaries, finance, retire. 
ment, and phases of instruction are areas 
in which it has made many useful cop. 
tributions. These areas require attention 
in both war and peace times, although 
changes in emphasis are necessary. 

Among the problems of any research 
division in these times is that of main. 
taining a large enough staff of trained 
persons to meet the demand for infor. 
mation and investigation. Not only is 
there a loss of personnel to government 
activities and to defense work, but there 
is pressure to assign people to duties that 
are more spectacular than research. Some 
of these “band wagon” procedures are 
expedient, but they should not be pro- 
vided at the expense of a proven research 
program. Another problem of a research 
division in this period is to have the nec- 
essary time to do its work. Consumers of 
research usually have little appreciation 
of the time required for reflection and in- 
vestigation in connection with research 
projects. Members of a mechanical, 
streamlined society often develop “sa 
nickel - in - the - slot, then-turn-the-crank” 
point of view with respect to research 
These are not insuperable problems, but 
they are lodged near the tap root of any 
research division and may determine the 
future of the division’s development. 

This statement was prepared by Frank 
W. Hubbard, director of the Research 
Division. 








